Member of Technical Staff, Training Engineer (Large Scale Foundation Models)
FirstPrinciplesWorldwide
Posted October 10, 2025
Full Time
About the Company
FirstPrinciples is a venture capital firm specializing in B2B SaaS companies, with a focus on Martech, Fintech, and HR. The company develops comprehensive marketing and sales strategies, along with agile product engineering processes to build scalable enterprise applications quickly. FirstPrinciples aims to create $100mm in enterprise value within seven years and invests heavily in talent development, operating a remote team of over 110 people, primarily based in India.
Job Description
FirstPrinciples is a non-profit organization dedicated to advancing the understanding of fundamental physics laws through AI. They are seeking a Member of Technical Staff to lead end-to-end pre-training of large language models on GPU clusters. This role involves optimizing data pipelines, distributed training, and rigorous evaluation to improve the AI Physicist platform and push research forward. The ideal candidate will combine engineering expertise with research intuition to maximize performance and production viability.
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- 7-12+ years of total experience, including 2+ years training large Transformers at scale.
- Hands-on experience with at least one frontier-style training run.
- Expert-level proficiency in PyTorch and CUDA/Triton fundamentals.
- Strong application mathematics background for training stability.
- Strong applied mathematics background for training stability (optimization, numerics, initialization, learning rate scaling).
- Ability to work cross-functionally and collaborate in a fast-growing environment.
Benefits
- Competitive salary
- Comprehensive benefits package
- Opportunities for professional development
