Senior AI QA Test Analyst

Role Overview

Join the engineering organization for Nasdaq Investor Relations and Sustainable Lens products. The main objective for the team in Bangalore is to build innovative IR and ESG solutions for corporates. As our new member, you will work with a group of enthusiastic and expert team members. Together with your team, you will be responsible for delivery of enhancements and supporting rearchitecture of the enterprise product to new software paradigms.

What You Will Do

Develop and maintain comprehensive automated test suites for generative AI models, including language models, and multimodal systems. Create innovative testing strategies to validate the quality, coherence, and safety of AI-generated content.

Why It Might Be a Fit

We are looking for candidates who share those values along with a genuine desire and drive to deliver top technology solutions to today's markets. You will have the opportunity to work with a group of enthusiastic and expert team members and contribute to the delivery of enhancements and supporting rearchitecture of the enterprise product.

Requirements

• Bachelor's or Master's degree in Computer Science, AI/ML, or related technical field
• 2-4 years of experience in software test automation, with at least 2 years focused on AI/ML systems, preferably generative AI
• Strong programming skills in Python
• Solid understanding of AI/ML algorithms and ability to validate their accuracy, bias, and performance
• Expertise in test automation tools and frameworks suitable for AI testing tools/frameworks like RAGAS, Deep eval, TrueLens, AWS Bedrock Evaluator, pytest, Robot Framework
• Experience in testing AI-driven applications, including data validation, model performance validation, and AI explainability
• Strong analytical and problem-solving skills, with a deep understanding of AI risks and mitigation strategies
• Solid experience in reviewing architectures, test strategies, and automation frameworks
• Knowledge of statistical analysis, probability, and mathematical modeling to validate AI systems
• Experience with AWS Bedrock, vectorized databases, and Sonnet/LLM algorithms
• Experience in performance testing of AI models and large-scale distributed systems

Benefits

• Join the engineering organization for Nasdaq Investor Relations and Sustainable Lens products
• Work with a group of enthusiastic and expert team members
• Contribute to the delivery of enhancements and supporting rearchitecture of the enterprise product
• Opportunity to work on innovative IR and ESG solutions for corporates
• Hybrid-first environment that accepts work-life balance and well-being