Applied AI Software Engineer
Canvas MedicalSan Francisco, California, United States • United States
Posted June 4, 2025
300000 - 400000 USD year
Full Time
About the Company
Canvas Medical offers a platform enabling healthcare companies to rapidly launch and scale new care and payment models.
Job Description
Canvas Medical is hiring an Applied AI Software Engineer to lead evaluations for agents in development and the post-deployment fleet of agents operating in Canvas to automate work for healthcare customers. The role requires deep experience evaluating LLM-based agents at scale and designing and running rigorous evaluation experiments.
Requirements
- 5+ years of experience in applied machine learning or AI engineering, with a focus on evaluation and benchmarking.
- Proficiency with foundation model APIs and experience orchestrating complex agent behaviors via prompts or tools.
- Experience designing and running high-throughput evaluation pipelines, ideally including human-in-the-loop or expert-labeled benchmarks.
- Superlative Python engineering skills and familiarity with experiment management tools and data engineering toolsets in general including, yes, SQL and database management.
Benefits
- Competitive Salary & Equity Package
- Health Insurance
- Home Office Stipend
- 401k
- Paid Maternity/Paternity Leave (12 weeks)
- Flexible/unlimited PTO
