We are looking for a Quality Analyst Project Coordinator to support the development of advanced AI tools for product attribution, classification and other purposes. This project focuses on creating a rich and diverse dataset of written German text, annotated and corrected by humans.
Requirements
- Review and audit labeled datasets for both text and image-based content to ensure accuracy, consistency, and adherence to guidelines.
- Document and share feedback with the individual labelers
- Identify trends and insights in quality performance, and effectively mitigate quality performance issues.
- Communicate quality trends and insights to the customer.
- Evaluate responses generated by AI, verifying correctness, clarity, relevance, and alignment with task instructions.
- Apply knowledge of Consumer Packaged Goods domain to accurately classify and/or describe products.
- Collaborate with cross-functional teams to update labeling workflows and improve quality.
- Monitor performance metrics (e.g., accuracy rates, inter-rater agreement) and contribute to continuous improvement initiatives.
- Generate responses with intentional but realistic grammar, spelling, and structural errors.
- calibration sessions to align QA standards across teams and help train new reviewers or analysts.
- Adapt quickly to evolving guidelines, new task types, and AI model updates in a fast-paced, iterative environment.
- Ensure that documentation is up to date.
Benefits
- medical, dental, and vision insurance
- long-term disability insurance
- life, and AD&D insurance
- employer-matching Group RRSP
- generous holiday and vacation policies
- monthly fitness stipend
- monthly cell phone reimbursement
- professional development opportunities