AI Research Engineer, Enterprise Evaluations
Scale AISan Francisco, California, United States • New York, New York, United States
Posted November 12, 2025
179400 - 224250 USD
Full Time
About the Company
At Scale, our mission is to develop reliable AI systems for the world's most important decisions.
Job Description
Scale AI is seeking a technically rigorous and driven AI Research Engineer to join our Enterprise Evaluations team. This high-impact role is critical to our mission of delivering the industry's leading GenAI Evaluation Suite. You will be a hands-on contributor to the core systems that ensure the safety, reliability, and continuous improvement of LLM-powered workflows and agents for the enterprise.
Requirements
- Partner with Scale’s Operations team and enterprise customers to translate ambiguity into structured evaluation data
- Analyze feedback and collected data to identify patterns, refine evaluation frameworks, and establish iterative improvement loops
- Design, research, and develop LLM-as-a-Judge autorater frameworks and AI-assisted evaluation systems
Benefits
- Comprehensive health, dental and vision coverage
- Retirement benefits
- Learning and development stipend
- Generous PTO
- Commuter stipend