Model Evaluation QA Lead

As Model Evaluation QA Lead, you'll be responsible for ensuring model quality assurance across Deepgram's AI pipeline. You'll design automated evaluation frameworks, integrate model quality gates into release pipelines, and drive industry-standard benchmarking.

Requirements

• 4–7 years of experience in QA engineering, ML evaluation, or a related technical role
• Hands-on experience building automated test/evaluation pipelines for ML models
• Strong programming skills in Python
• Familiarity with speech/audio ML concepts
• Experience with CI/CD integration for ML workflows

Benefits

• Medical, dental, vision benefits
• Annual wellness stipend
• Mental health support
• Life, STD, LTD Income Insurance Plans
• Unlimited PTO
• Generous paid parental leave
• Flexible schedule
• 12 Paid US company holidays
• Quarterly personal productivity stipend
• One-time stipend for home office upgrades
• 401(k) plan with company match
• Tax Savings Programs