Research Engineer - Midtraining

We are an AI + physical sciences lab building state of the art models to make novel scientific discoveries. You will train frontier models to be highly knowledgeable scientific experts that serve as the foundation for reinforcement learning.

Requirements

• Training LLMs on curated mixes of trillions of tokens
• Calculating scaling laws and compute-optimal hyperparameters
• Generating billions of tokens of high-quality synthetic data
• Building evals that correlate with downstream task performance