Senior Software Engineer, Inference

We are looking for a Senior Software Engineer to join our Inference team. The team is responsible for building and maintaining critical systems that serve Claude to millions of users worldwide. The ideal candidate will have significant software engineering experience, particularly with distributed systems, and a bias towards flexibility and impact.

Requirements

• High-performance, large-scale distributed systems
• Implementing and deploying machine learning systems at scale
• Load balancing, request routing, or traffic management systems
• LLM inference optimization, batching, and caching strategies
• Kubernetes and cloud infrastructure (AWS, GCP)
• Python or Rust

Benefits

• Competitive compensation
• Benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Lovely office space