Ai2 is seeking a Research Engineer to join the FlexOlmo team, working on large language models for flexible data use. The role involves building infrastructure, optimizing training and inference, and collaborating with an open-source community. The ideal candidate has expertise in modern deep learning, natural language processing, and software engineering, with a strong understanding of the transformer architecture and MoEs.
Requirements
- Bachelor's degree in Data Science/CS/EE/Applied Mathematics/Statistics/ML/NLP, or a related field, or equivalent relevant experience
- 4+ years of experience building infrastructure that handles data preprocessing/transformation and model training, evaluation, inference, and deployment
- Knowledge of modern deep learning and natural language processing techniques
- Strong software engineering skills, particularly around building performant systems and debugging
- Experience with Python and PyTorch/Jax/Tensorflow
- Familiarity working with cloud compute resources (e.g. AWS) and containerization (e.g. Docker)
- Strong collaboration and communication skills
- Advanced degree in Data Science/CS/EE/Applied Mathematics/Statistics/ML/NLP or related fields and/or relevant and equivalent engineering experience
- Contributions to open-source ML or research libraries (e.g. spaCy, AllenNLP, transformers)
- Experience successfully operating models at scale in a production setting
- Experience in HPC settings
- Curiosity about AI research
Benefits
- Medical, dental, vision, basic life insurance, basic accidental death and dismemberment insurance, short-term disability, long-term disability, and an employee assistance program
- Voluntary life insurance program, voluntary accidental death and dismemberment program, health savings account plan, healthcare reimbursement arrangement plan, and health care and dependent care flexible spending account plans
- 401k plan
- $125 per month for commuting or internet expenses and $200 per month for fitness and wellbeing expenses
- Up to ten sick days per year, up to seven personal days per year, up to 20 vacation days per year and twelve paid holidays throughout the calendar year
- Annual bonuses and participation in the long-term incentive plan
