Quality Engineer AI

Quality Engineer (AI)

Atlanta, GA (Onsite - Local Candidates Only)

Contract

4+ years in QA/Software Testing; 2+ years testing AI/ML applications

We are seeking an experienced Quality Engineer with a strong AI/ML testing background to join a dynamic team at a leading retail organization. You will be responsible for designing and executing test strategies for intelligent, AI-powered systems and ensuring quality across the full development lifecycle.

• Design and execute comprehensive test strategies for AI/ML-based applications and intelligent systems
• Validate AI model performance, accuracy, fairness, robustness, and reliability
• Develop automated testing frameworks for web, mobile, APIs, and AI-powered applications
• Create and execute test cases for model inference, prompt testing, hallucination detection, and response validation
• Perform functional, integration, regression, performance, and security testing
• Validate training datasets, model outputs, and data pipelines
• Collaborate with Data Scientists, AI Engineers, Product Managers, and Developers
• Monitor AI system behavior in production and identify quality improvement opportunities
• Define quality metrics, KPIs, and dashboards for AI solution performance
• Support CI/CD and continuous testing within DevOps pipelines

• QA & Testing: Quality Engineering, Test Strategy, Manual & Automated Testing, Functional, Regression, API, Performance & Security Testing, Defect Management
• AI/ML Testing: Model Validation, Prompt Testing, Hallucination Detection, Bias & Fairness Testing, Data Quality Testing, AI Performance Monitoring
• Automation Tools: Selenium, Playwright, Cypress, Postman, Rest Assured, JMeter
• Programming: Python, Java, JavaScript/TypeScript
• Cloud & DevOps: Azure, AWS, GCP, GitHub Actions, Azure DevOps, Jenkins, CI/CD Pipelines

• Retail domain experience (required)
• Strong understanding of STLC and SDLC

Onsite - Atlanta, GA. Local candidates only.

Contract engagement. Immediate sourcing underway - apply with your updated resume to be considered.