Senior Software Engineer - Together Cloud Platform

Together AI is building a new AI Acceleration Cloud to serve end-to-end generative AI lifecycle services, combining LLMs with AI cloud infrastructure. The Senior Backend Engineer will contribute to building the next generation AI cloud platform, a high-availability, global infrastructure for managing ML hardware and supporting both internal and external cloud customers. This role involves developing distributed systems, managing compute and networking resources, and designing new cloud platform services.

Requirements

• 5+ years of experience in building large-scale, fault-tolerant, distributed systems and API microservices
• Experience designing, analyzing, and improving efficiency, scalability, and stability of various system resources
• Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members
• Demonstrated experience with building and operating high-performance and/or globally distributed microservice architectures across one or more cloud providers
• Strong systems knowledge across compute, networking, and storage
• Experience developing against and managing a relational database, such as PostgreSQL
• Expert-level programmer in one or more programming languages (Golang preferred)
• Proficiency in version control practices and integrating IaC with CI/CD pipelines
• Experience with Kubernetes and containers preferred

Benefits

• Competitive compensation
• Startup equity
• Health insurance
• Remote work flexibility