Research Scientist in Sequence Modeling
Cape Town
Research – Science /
Permanent /
Hybrid
InstaDeep, founded in 2014, is a pioneering AI company at the forefront of innovation. With strategic offices in major cities worldwide, including London, Paris, Berlin, Tunis, Kigali, Cape Town, Boston, and San Francisco, InstaDeep collaborates with giants like Google DeepMind and prestigious educational institutions like MIT, Stanford, Oxford, UCL, and Imperial College London. We are a Google Cloud Partner and a select NVIDIA Elite Service Delivery Partner. We have been listed among notable players in AI, fast-growing companies, and Europe's 1000 fastest-growing companies in 2022 by Statista and the Financial Times. Our recent acquisition by BioNTech has further solidified our commitment to leading the industry.
Join us to be a part of the AI revolution!
InstaDeep is looking for a new Research Scientist to join our expanding Research team in Cape Town. The research focus of this position is on conversational large language models for biology. Our efforts are towards developing valuable research works and breakthroughs in foundational models for biology that were previously out of reach.
In the Research team, the role of a Research Scientist is to contribute to the research effort through the development and implementation of novel ideas, whilst building modular, sustainable and scalable software solutions. As a Research Scientist, you will have the opportunity to shape both our science and research culture.
The core tasks of a Research Scientist in this role include: researching new areas in the fine-tuning of transformer-based models, reinforcement learning, proposing solutions to existing problems, implementing those solutions in a team setting, and contributing to InstaDeep’s publication efforts.
We welcome applications from any background and foster an open and accepting environment. InstaDeepers are naturally helpful people who want to help others grow and succeed. We strongly encourage and support applications from underrepresented groups in the tech industry.
Role responsibilities:
- Implement and develop novel algorithms and research ideas in fields such as machine learning, deep learning, reinforcement learning, and large language models.
- Contribute to our publication efforts.
- Encourage and support good research practices as ideas are translated into projects.
- Design and implement algorithms to leverage modern hardware.
- Report and present experimental results and research findings clearly and efficiently, both internally and externally, verbally and in writing.
- From time-to-time, collaborate with the business development team in their pre-sales activities, including presenting the company to prospective clients and representing InstaDeep at conferences/events.
Requirements:
- Postgraduate degree in Computer Science, Engineering, Computational Biology, Machine Learning or a related scientific field or equivalent industry experience.
- Work permit for South Africa.
- Experience in developing and debugging in Python or similar languages.
- Experience using deep learning frameworks such as Jax, PyTorch and/or Tensorflow.
- Experience in publishing research in machine learning or other related fields.
Desirables
- Large Language Model Expertise: Have experience with the development, training, and fine-tuning of large transformer models. This includes familiarity with LLM training pipelines, model optimization for specific tasks, and experience in deploying these models for real-world applications.
- Reinforcement Learning from Human Feedback (RLHF): Possess a basic understanding of RLHF techniques, demonstrating how they can be utilized to refine the performance of language models based on user interactions and feedback.
Our commitment to our people
We empower individuals to celebrate their uniqueness here at InstaDeep. Our team comes from all walks of life, and we’re proud to continue encouraging and supporting applicants from underrepresented groups across the globe. Our commitment to creating an authentic environment comes from our ability to learn and grow from our diversity, and how better to experience this than by joining our team? We operate on a hybrid work model with guidance to work at the office at least 2 to 3 days per week to encourage close collaboration and innovation. We are continuing to review the situation with the well-being of InstaDeepers at the forefront of our minds.
Right to work: Please note that you will require the legal right to work in the location you are applying for.
