Distributed Training Engineer

We are an AI + physical sciences lab building state of the art models to make novel scientific discoveries. You will optimize, operate and develop large-scale distributed LLM training systems that power AI scientific research.

Requirements

• Optimizing training throughput for large scale Mixture-of-Expert models
• Training on clusters with ≥5,000 GPUs
• 5D parallel LLM training