The Associate Manager, AI-Enablement & Grading Effectiveness is responsible for leading a team of Grading Effectiveness Specialists to ensure consistent, high-quality grading practices across the grading team. This role owns audit strategy, execution oversight, and performance outcomes related to grading quality and academic integrity.
Requirements
- Define and own the grading audit framework, standards, and performance thresholds.
- Integrate AI-driven pre-audit triage and anomaly detection into sampling and audit strategy.
- Establish audit cadence, sampling strategy, and reliability benchmarks.
- Oversee audit execution and ensure consistency, objectivity, and measurable quality improvement.
- Architect and scale AI-powered audit workflows using generative AI platforms (e.g., ChatGPT), including prompt engineering, agent configuration, and structured rubric ingestion.
- Design and refine prompt libraries, evaluation schemas, and escalation logic to ensure reliability and grading consistency.
- Establish human-in-the-loop review standards, calibration loops, and drift detection thresholds.
- Monitor AI performance metrics (precision, consistency, bias, hallucination rates) and iterate on prompts and workflows to improve reliability and throughput.
- Manage and develop a team of Grading Effectiveness Specialists.
- Set clear output, reliability, and impact expectations.
- Coach team members to strengthen analytical capability and audit effectiveness.
- Translate audit data into actionable insights, systemic opportunities and strategic recommendations.
- Collaborate cross-functionally to drive improvement initiatives.
- Oversee quality dashboards and executive reporting.
- Align grading quality initiatives across Academic, Operations, and Product teams.
- Ensure accurate documentation and confidentiality of audit findings.
Benefits
- Medical, dental, vision, life and disability plans
- Well-being incentives
- Parental leave
- Paid time off
- Certain paid holidays
- Tax saving accounts (FSA, HSA)
- 401(k) retirement benefit
- Employee Stock Purchase Plan
- Tuition assistance
- Entertainment and retail discounts
