Machine Learning Engineer
Together AISan Francisco, California, United States
Posted August 12, 2025
160000 - 220000 USD year
Full Time
About the Company
Together AI is a research-driven AI cloud infrastructure provider offering a purpose-built GPU platform for training and running advanced AI models. Serving leading SaaS companies and pioneering startups, Together AI champions open source AI and decentralized computing, advocating for transparency to drive innovation and societal benefits.
Job Description
Together AI is seeking a Machine Learning Engineer to develop systems and APIs for inference and fine-tuning Large Language Models (LLMs). The role involves building production systems for inference, handling large-scale workloads, and contributing to research and product development. The engineer will be responsible for designing, building, and improving system resources to ensure reliability and performance.
Requirements
- 5+ years experience writing high-performance, well-tested, production-quality code
- Bachelor’s degree in computer science or equivalent industry experience
- Familiar with LLM inference ecosystem (vLLM, SGLang, TRT, etc.)
- Experience building large-scale, fault-tolerant, distributed systems
- Expert level programmer in Python, Go, Rust, or C/C++
- Experience implementing runtime inference services at scale
- Design and code reviews
- Creation of testing frameworks
- Participation in an on-call rotation
Benefits
- Competitive compensation
- Startup equity
- Health insurance