Our client, a leading digital innovation company, is seeking a Senior QA Engineer to lead quality assurance for AI-powered solutions, with a focus on Generative AI and complex platform applications. This is an exciting opportunity to define testing strategies for cutting-edge AI systems in a collaborative, agile environment.
What You’ll Do:
- Design and implement comprehensive testing frameworks for Generative AI applications, LLM-based systems, and AI agent workflows
- Develop automated testing strategies for AI model outputs, including accuracy, relevance, bias detection, and safety validation
- Execute manual and automated testing of platform UI, conversational AI, and multi-system integrations
- Create and maintain API test suites for REST/GraphQL endpoints and AI service integrations
- Build and maintain CI/CD testing pipelines with automated regression testing for platform features and AI model behavior
- Establish quality metrics, guardrails, and ethical AI compliance protocols
- Perform load and performance testing for AI inference, model serving, and real-time applications
- Collaborate with engineering teams to integrate QA into development workflows and enforce quality standards
Tech Stack:
- Automation & Testing: Selenium, Playwright, Postman, REST Assured, custom frameworks
- Programming: Python, JavaScript/TypeScript
- Cloud & AI: AWS, AI/ML services and infrastructure
- Performance Testing: JMeter, Locust, Artillery
- Methodologies: Agile, CI/CD, exploratory & usability testing, cross-platform validation
Requirements:
- 5+ years QA experience, with 2+ years focused on AI/ML or complex platforms
- Strong automated testing and CI/CD experience
- Experience testing APIs, UI, and AI-driven systems
- Knowledge of Generative AI applications, LLMs, AI agents, and prompt-based systems
- Understanding of AI/ML evaluation metrics and testing methodologies for non-deterministic outputs
- Bachelor’s degree in Computer Science, Engineering, or related field
