Staff Software Engineer, Inference

Anthropic's Inference team is responsible for building and maintaining the critical systems that serve Claude to millions of users worldwide. As a Staff Software Engineer, you will work end to end, identifying and addressing key infrastructure blockers to serve Claude while enabling breakthrough AI research.

Requirements

• Familiarity with performance optimization, distributed systems, large-scale service orchestration, and intelligent request routing
• High-performance, large-scale distributed systems
• Implementing and deploying machine learning systems at scale
• Load balancing, request routing, or traffic management systems
• LLM inference optimization, batching, and caching strategies
• Kubernetes and cloud infrastructure (AWS, GCP)
• Python or Rust

Benefits

• Competitive compensation
• Optional equity donation matching
• Generous vacation and parental leave
• Flexible working hours