AI Quality Associate focuses on validating the quality of AI-generated outputs, agent behaviors, and AI-assisted workflows. This role will be critical in building benchmark scenarios, defining scoring rubrics, evaluating business usefulness, and identifying failure patterns.
Requirements
- 4+ years of experience in QA, analytics, business process validation, AI evaluation, operations, or similar roles
- Strong writing, analysis, and pattern-recognition skills
- Experience evaluating outputs against nuanced criteria rather than only binary correctness
- Experience with finance, accounting, FP&A, transaction services, or business process design preferred
- Ability to work with structured rubrics, scenario libraries, and evidence-based reviews
- Ability to spot subtle output problems others miss
- Comfort with ambiguity but disciplined in scoring and documentation
- Comfort collaborating across Engineering and business teams, with a focus on trust, usefulness, and business reality
- Bachelor's degree preferred
Benefits
- Generous Paid Time Off
- 401k Matching
- Retirement Plan
- Bonus
