Member of Technical Staff, Model Evaluation
InceptionSan Francisco, California, United States
Posted March 10, 2026
Full Time
About the Company
Inception is a pioneering company that harnesses AI to revolutionize industries and redefine what's possible. With a mission to deliver best-in-class AI models and solutions as a service, we leverage the latest tools and techniques to make companies smarter, more efficient, and future-ready. By pushing the boundaries of AI-powered human evolution, we're committed to exploring new frontiers and shaping a smarter future. Join our team to be part of this innovative journey.
Job Description
We seek experienced engineers and scientists to develop evaluation metrics and systems for LLM performance. The role involves designing frameworks, defining metrics, building scalable evaluation pipelines, and conducting statistical analysis of model outputs.
Requirements
- BS/MS/PhD in Computer Science, Machine Learning, Statistics, or a related field
- At least 2 years of experience in ML evaluation, applied ML research, or a related engineering role
- Strong understanding of LLM fundamentals
- Proficiency in Python and ML frameworks such as PyTorch
- Experience designing and implementing evaluation metrics and benchmarks for generative models
- Solid foundation in statistics, experimental design, and hypothesis testing
- Experience with version control (Git) and containerization (Docker)
