Haystack
← Back to Jobs
Engineering
SO

Quality Engineer (AI)

SolutionIT, Inc.Atlanta, GA🇺🇸United StatesPosted 21 Aug 2026

Why This Role Stands Out

Advance your career with this exciting Quality Engineer role at SolutionIT, Inc., where you'll shape the future of AI applications and gain invaluable experience in a hybrid work environment. If you thrive on complex challenges, possess a keen eye for detail, and enjoy collaborating with innovative teams to ensure cutting-edge AI solutions meet the highest standards, this is a fantastic opportunity to apply your skills.

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Atlanta, GA, United States
Posted
5 days ago

Job Description

Solution IT Inc. is looking for Quality Engineer (AI) for one of its clients in Atlanta, GA

Job Title: Quality Engineer (AI)

Responsibilities:

  • Design and execute comprehensive test strategies for AI/ML-based applications and intelligent systems.
  • Validate AI model performance, accuracy, fairness, robustness, and reliability.
  • Develop automated testing frameworks for web, mobile, APIs, and AI-powered applications.
  • Create and execute test cases for model inference, prompt testing, hallucination detection, and response validation.
  • Perform functional, integration, regression, performance, and security testing.
  • Validate training datasets, model outputs, and data pipelines to ensure quality and consistency.
  • Collaborate with Data Scientists, AI Engineers, Product Managers, and Developers throughout the development lifecycle.
  • Monitor AI system behavior in production and identify quality improvement opportunities.
  • Define quality metrics, KPIs, and dashboards for AI solution performance.
  • Identify testing bottlenecks and implement process improvements.
  • Ensure compliance with responsible AI principles, privacy requirements, and organizational quality standards.
  • Support continuous integration and continuous testing within DevOps pipelines.

Required Skills:

  • Bachelor's degree in computer science, Information Technology, Engineering, or a related field.
  • 4+ years of experience in Software Quality Engineering, QA Automation, or Testing.
  • 2+ years of experience testing AI/ML-based applications or data-driven systems.
  • Strong understanding of Software Testing Life Cycle (STLC) and SDLC.
  • Experience with test automation tools and frameworks.
  • Knowledge of machine learning concepts, model validation techniques, and data quality testing.
  • Experience in API, UI, and backend testing.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Excellent communication and collaboration skills.

Technical Skills

  • Quality Engineering
  • Test Strategy & Planning
  • Manual & Automated Testing
  • Functional & Regression Testing
  • API Testing
  • Performance & Security Testing
  • Defect Management

AI/ML Testing

  • Model Validation & Evaluation
  • Prompt Testing
  • Hallucination Detection
  • Bias & Fairness Testing
  • Data Validation & Data Quality Testing
  • AI Performance Monitoring

Automation Tools

  • Selenium
  • Playwright
  • Cypress
  • Postman
  • Rest Assured
  • JMeter

Programming

  • Python
  • Java
  • JavaScript/TypeScript

Cloud & DevOps

  • Azure / AWS / Google Cloud Platform
  • GitHub Actions
  • Azure DevOps
  • Jenkins
  • CI/CD Pipelines

Work Site: Atlanta, GA

Duration: 6 Months C2C

Expected Start Date: Immediate

Number of Positions: 01

Please send your responses back to

Thanks

Recruiting Team

SOLUTION IT INC

Work: / Extn 143 / 150

URL:
Confidentiality Notice: The material in this e-mail is intended only for the use of the individual to whom it is addressed and may contain information that is confidential, privileged, and exempt from disclosure under applicable law. If you are not the intended recipient(s), be advised that the unauthorized use, disclosure, copying, distribution, or the taking of any action in reliance on this information is strictly prohibited. If you have received this e-mail in error, please immediately contact the sender by reply email and destroy all copies of the original message. Thank you.

Under Bill s.1618 Title III passed by the 105th U.S. Congress this mail cannot be considered as "spam" as long as we include contact information and a remove link for removal from our mailing list. In order to not be in the recipients-list for this mail, please reply to us with "REMOVE" either in the subject or in the mail body. Please include all pertinent email addresses. Our apologies for any inconveniences caused by this mail.

to remove from our mailing list.
Solution IT, Inc, 60E Concord St, Wilmington, MA 01887 Phone: Fax:

Similar jobs

Apply now