AI Infrastructure Engineer, Model Serving Platform
Scale AISan Francisco, California, United States • New York, New York, United States
Posted January 28, 2025
175000 - 220000 USD year
Full Time
About the Company
Scale accelerates AI development with tools for high-quality data curation and generative model customization.
Job Description
As a software engineer on the ML Infrastructure team, you will work on developing the platform for orchestrating post-training and model evaluation jobs. You will develop re-usable platforms for running in-house and open-source LLM-benchmarks, ensure correctness and performance of post-training and eval jobs on the platform, and contribute to foundational infrastructure at the company for model inference and training.
Requirements
- 4+ years of experience developing ML platforms
- Passion for working closely with researchers to drive business impact
- Experience training and/or benchmarking LLMs
- Experience with Python, Docker, Kubernetes, and Infrastructure as code (e.g. terraform)
Benefits
- Comprehensive health, dental and vision coverage
- Retirement benefits
- A learning and development stipend
- Generous PTO
- Commuter stipend
