Staff Software Engineer, Inference

Anthropic's mission is to create reliable, interpretable, and steerable AI systems. Our Inference team is responsible for building and maintaining the critical systems that serve Claude to millions of users worldwide. We are a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

Requirements

• High-performance, large-scale distributed systems
• Implementing and deploying machine learning systems at scale
• Load balancing, request routing, or traffic management systems
• LLM inference optimization, batching, and caching strategies
• Kubernetes and cloud infrastructure (AWS, GCP)
• Python or Rust

Benefits

• Competitive compensation and benefits
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours
• Lovely office space in which to collaborate with colleagues