Haystack
← Back to Jobs
Remote
Other
TD

QA AI Lead - Remote

The Dignify Solutions, LLCUnited States🇺🇸United StatesPosted Sep 18, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Remote
Location
United States
Posted
19 hours ago
Generative AI

Job Description

  • 10+ years of experience in Software Quality Assurance.
  • 5+ years of Test Automation experience.
  • 3+ years of experience testing AI/ML or Generative AI solutions.
  • Experience leading QA teams and enterprise testing programs.

AI Quality Engineering Leadership

  • Define and implement enterprise-wide AI testing and quality assurance strategies.
  • Establish testing standards, governance, and best practices for AI/ML and Generative AI applications.
  • Lead QA activities across AI product lifecycle from development through production deployment.
  • Drive AI-powered quality engineering transformation initiatives.

AI & Generative AI Testing

  • Validate LLMs, Chatbots, Copilots, and GenAI applications.
  • Develop test scenarios for:
  1. Prompt validation
  2. Hallucination detection
  3. Bias and fairness testing
  4. Security and privacy testing
  5. Performance and scalability testing
  6. Explainability validation
  • Define AI model quality metrics and monitoring standards.
  • Automation & Quality Engineering
  • Design and implement automated testing frameworks.
  • Integrate automated testing into CI/CD pipelines.
  • Establish AI-assisted test generation and test optimization strategies.
  • Drive shift-left and continuous testing practices.

Similar jobs