Research Scientist - Distributed Machine Learning

We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. As a Research Scientist, you will work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development.

Requirements

• 5+ years combined industry or hands-on research experience with large-scale deep-learning training
• Led at least one large-scale transformer pre-training run
• Expert PyTorch or JAX/Flax plus DeepSpeed, FSDP, Megatron-LM, or MosaicML Composer
• Experience with distributed training at scale (100+ GPUs)
• Proven multi-node GPU work (Slurm, K8s, or Ray) and NCCL/GLOO debugging
• Strong software engineering skills on large ML codebases
• Ownership of mixed- or low-precision paths (bf16, fp8, 4-bit) with accuracy validation
• Clear written communication (design docs, RFCs, post-mortems)

Benefits

• Comprehensive medical, dental, and vision benefits
• Bonus
• 401K Plan
• Generous paid time off, sick leave and holidays
• Paid Parental Leave
• Employee Assistance Program
• Life insurance and disability