Haystack
← Back to Jobs
Technology
DE

QA Engineer with AI testing

DTEL Engineering & Consultants IncCharlotte, NC🇺🇸United StatesPosted 31 Aug 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Charlotte, NC, United States
Posted
17 hours ago
Machine LearningData PipelineGenerative AIPythonpytest

Job Description

Primary Skill: Test AI applications, RAG systems, agents, APIs and Data Pipeline using automated development framework

Experience: Minimum 8 years

Roles & Responsibilities

Bachelor s or master s degree in computer science or related field.

Key Responsibilities

  • Lead Strategy: Design end-to-end test plans for generative AI, LLMs, and machine learning models.
  • Model Validation: Test models for accuracy, drift, latency, robustness, and security vulnerabilities.
  • Automation: Build advanced test automation frameworks using Python, PyTest, and specialized AI testing tools.
  • Data Quality: Validate training, validation, and test datasets for bias, leakage, and data integrity.
  • Performance Testing: Evaluate system scalability and response times under heavy concurrent loads.
  • Team Leadership: Mentor junior engineers and collaborate with data scientists and software developers.
  • Certifications in Automation

Similar jobs