Haystack
← Back to Jobs
Other
AA

AI Quality Engineer

ARCCA Analytics And IT Solutions LLCNew York, NY🇺🇸United StatesPosted Sep 22, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
New York, NY, United States
Posted
2 days ago
DockerFastAPIMicroservicesAzureKubernetesPythonStakeholder Management

Job Description

Job:  AI Quality Engineering Lead  

Location: Newyork NY

Experience: 8+ years

AI/GenAI Experience: 3+ years
Role Type: Technical Lead / Architect
Education: Bachelor’s degree or higher

Job Description

We are seeking an AI Quality Engineering Lead with strong experience in Quality Engineering, Test Automation, Software Engineering, AI/ML, and Technology Transformation to lead the adoption of AI-powered Quality Engineering capabilities across the Testing Center of Excellence (TCoE).

This is a hands-on technical leadership role focused on designing, implementing, and scaling enterprise AI solutions that improve software quality, engineering productivity, automation, and SDLC efficiency.

The role will focus on Agentic AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Multi-Agent Systems, AI-powered testing, and reusable engineering accelerators.

Key Responsibilities

  • Lead enterprise adoption of AI-powered Quality Engineering capabilities across the SDLC.
  • Define AI Quality Engineering strategy, roadmap, standards, and governance.
  • Design and implement Agentic AI solutions using LangChain, LangGraph, LLMs, RAG, and Multi-Agent architectures.
  • Build reusable AI frameworks, accelerators, libraries, reference implementations, and engineering playbooks.
  • Implement AI solutions for:
    • Requirements analysis
    • Test case generation
    • Test automation
    • Defect analysis
    • Traceability validation
    • Test data generation
    • Knowledge management
    • Documentation generation
    • Quality reporting and analytics
  • Establish Responsible AI, Human-in-the-Loop, AI observability, model evaluation, security, and governance standards.
  • Integrate AI solutions with DevOps and CI/CD pipelines.
  • Evaluate emerging AI technologies and provide enterprise adoption recommendations.
  • Define AI adoption KPIs, ROI measurements, and value-realization frameworks.
  • Provide technical leadership and mentoring to engineering teams.
  • Partner with Engineering, Architecture, DevOps, Security, Product, and Vendor teams.

Required Technical Skills

Must Have:

  • 8+ years in Quality Engineering / Software Engineering / Test Automation / AI/ML / Technology Delivery
  • 3+ years designing and implementing AI/ML, GenAI, or Agentic AI solutions
  • Strong Python
  • FastAPI
  • LangChain
  • LangGraph
  • LLMs
  • RAG / Retrieval-Augmented Generation
  • Multi-Agent Systems
  • Prompt Engineering
  • AI/ML Solution Architecture
  • Microservices
  • API-first architecture
  • Event-driven architecture
  • Docker
  • Kubernetes
  • DevOps / CI/CD
  • SDLC and Quality Engineering
  • AI governance / Responsible AI
  • Human-in-the-Loop controls
  • AI security and engineering standards
  • Strong technical leadership and stakeholder management.

Preferred Skills

  • Enterprise Test Automation Frameworks
  • AI observability and monitoring
  • Model evaluation
  • Automated documentation generation
  • Release management
  • Engineering governance and operating models
  • Microsoft Azure AI
  • OpenAI
  • Azure AI Search
  • Cloud-native AI platforms
  • Engineering transformation
  • Enterprise AI adoption. 

Similar jobs