Member of Technical Staff, Model Efficiency
CohereNew York, New York, United States • Toronto, Ontario, Canada • San Francisco, California, United States • Montreal, Quebec, Canada
Posted November 7, 2025
Full Time
About the Company
Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each person is one of the best in the world at what they do.
Job Description
We're a fast-growing team of researchers and engineers focused on building reliable ML systems and pushing the boundaries of LLM inference efficiency. We're looking for a Member of Technical Staff to improve core performance metrics by diving deep into model execution, identifying bottlenecks, and developing innovative optimizations.
Requirements
- 5+ years of experience writing high-performance, production-quality code
- Strong programming skills in C++ or Python (Rust/Go also welcome)
- Experience working with large language models and familiarity with the LLM inference ecosystem
- Ability to diagnose and resolve performance bottlenecks across the model execution stack
- Strong bias for action — you ship fast, measure impact, and iterate
Benefits
- An open and inclusive culture and work environment
- Weekly lunch stipend, in-office lunches & snacks
- Full health and dental benefits
- 100% Parental Leave top-up for up to 6 months
- Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
- Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
- 6 weeks of vacation (30 working days!)
