AI Quality Architect

We're looking for an AI Quality Architect to join our team at NiCE. As an AI Quality Architect, you will design and architect quality into AI-accelerated pipelines from the ground up, ensuring every stage is observable, trustworthy, and continuously improving. You will work with our team to design and implement quality architecture, test engineering platforms, and quality gates in autonomous pipelines. You will also partner with ML platform and data science teams to establish quality acceptance criteria for every model and agent promoted to production. You will have 12+ years of software engineering experience, 4+ years as a principal architect or distinguished engineer, and direct production experience building or operating systems that incorporate LLMs or AI agents.

Requirements

• 12+ years in software engineering with strong depth across both development and quality engineering
• 4+ years as a hands-on principal architect or distinguished engineer with cross-org technical scope
• Direct production experience building or operating systems that incorporate LLMs or AI agents
• Background in large-scale CI/CD architecture and the performance engineering domain
• Enterprise SaaS or platform engineering background
• Deep, hands-on understanding of agentic AI patterns
• Expert-level prompt engineering
• Experience designing evaluation harnesses for non-deterministic AI systems
• Familiarity with agent frameworks and their tradeoffs in production quality pipelines

Benefits

• Flexible work arrangement (2 days in-office, 3 days remote)
• Endless internal career opportunities
• Collaborative, creative, and fast-paced work environment
• Chance to learn and grow as a market leader