Member of Technical Staff, Training Engineer (Large Scale Foundation Models)

FirstPrinciples is a non-profit organization dedicated to advancing the understanding of fundamental physics laws through AI. They are seeking a Member of Technical Staff to lead end-to-end pre-training of large language models on GPU clusters. This role involves optimizing data pipelines, distributed training, and rigorous evaluation to improve the AI Physicist platform and push research forward. The ideal candidate will combine engineering expertise with research intuition to maximize performance and production viability.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or related field.
• 7-12+ years of total experience, including 2+ years training large Transformers at scale.
• Hands-on experience with at least one frontier-style training run.
• Expert-level proficiency in PyTorch and CUDA/Triton fundamentals.
• Strong application mathematics background for training stability.
• Strong applied mathematics background for training stability (optimization, numerics, initialization, learning rate scaling).
• Ability to work cross-functionally and collaborate in a fast-growing environment.

Benefits

• Competitive salary
• Comprehensive benefits package
• Opportunities for professional development