Senior Software Engineer - Together Cloud Infrastructure
Together AISan Francisco, California, United States
Posted August 12, 2025
160000 - 230000 USD year
Full Time
About the Company
Together AI is a research-driven AI cloud infrastructure provider offering a purpose-built GPU platform for training and running advanced AI models. Serving leading SaaS companies and pioneering startups, Together AI champions open source AI and decentralized computing, advocating for transparency to drive innovation and societal benefits.
Job Description
Together AI is building the AI Acceleration Cloud, an end-to-end AI platform combining LLM inference with state-of-the-art cloud infrastructure. The Senior AI Infrastructure Engineer role will focus on building the next generation AI cloud platform, virtualizing hardware and enabling scalable ML services. The position involves designing, building, and maintaining a multi-terabyte data center, developing observability stacks, and automating infrastructure management.
Requirements
- 5+ years of professional software development experience
- Proficiency in at least one backend programming language (Golang preferred)
- Demonstrated experience with building and operating high-performance micro-services
- Experience with Kubernetes internals a plus
- Deep experience with VMs/hypervisors a big plus
- Experience with DC networking tech + solutions a big plus
- Experience with Cluster API or similar a big plus
- Strong systems knowledge across compute, networking, and storage
- Experience with infrastructure automation tools (Terraform, Ansible) and CI/CD pipelines
- Experience with DPUs/SmartNICs a plus
Benefits
- competitive compensation
- startup equity
- health insurance
- flexibility in terms of remote work
