Quick overview
Job description
Location : Remote
3 5+ years of experience in Quality Engineering, Quality Assurance, or Software Testing.
3+ years of test automation development experience using automation tools.
2+ years of experience testing AI, machine learning, Generative AI, large language models (LLMs), or intelligent automation solutions.
Experience validating AI-generated outputs for accuracy, reliability, traceability, safety, and consistency.
5+ years of Quality Engineering or Software Testing experience.
Experience testing LLM, retrieval-augmented generation (RAG), chatbot, conversational AI, AI agent, or Generative AI applications.
Experience developing AI evaluation frameworks, test harnesses, and automated model validation processes.
Experience assessing AI hallucinations, prompt robustness, model drift, bias, and adversarial scenarios.
Healthcare, payer, provider, or health technology experience.
Experience with cloud platforms such as Azure, AWS, or Google Cloud Platform.
Experience with MLOps, model lifecycle management, or AI governance processes.
Familiarity with accessibility testing and user experience validation.
Experience supporting AI governance, audit, risk, security, or regulatory reviews.
Experience mentoring QA engineers and driving quality engineering best practices.
Similar jobs
- JG

Senior Engineer, Quality Assurance EngineeringRecently posted
Judge Group, Inc. · Redmond, WA · Hybrid 🇺🇸
Engineering$60 - $70/hr - CI

Performance Tester
ComTec Information Systems · Newark, NJ · Hybrid 🇺🇸
ApacheArticulateJMeterSalary not listed - CS

SDET Architect - Remote / TelecommuteRecently posted
Cynet Systems · Fort Collins, CO · Remote 🇺🇸
SOC 2AgileTechnology$50 - $55/hr - RA

Senior Test Systems Engineer (Onsite Tucson, AZ)Recently posted
Raytheon · Albuquerque, NM · On-site 🇺🇸
AgileProject ManagementSystem DesignTechnology$86.8k - $165.2k/yr - BR

Sr. QA Engineer (Costa Rica - Remote)Recently posted
Braintrust · San Jose, CA · Remote 🇺🇸
GitCypressGitHub Actions+8Technology$45 - $55/hr - SA
AI Training and Quality Assurance Analyst (Remote)Recently posted
Scale AI · Cincinnati, Ohio · Remote 🇺🇸
OnboardingTechnology$15/hr - IS

Call Quality Assurance AnalystRecently posted
iSpace, Inc · United States · Hybrid 🇺🇸
Microsoft OfficeCall CenterCompliance+2TechnologySalary not listed - AS
Quality Assurance LeadRecently posted
Apex Systems · Lincoln, NE · On-site 🇺🇸
SQLGitHTML+13TechnologySalary not listed - CO
Senior Databricks Data QA Engineer/Data EngineeringRecently posted
COOLSOFT · United States · Hybrid 🇺🇸
SQLApache SparkETL+9TechnologySalary not listed - PR
W2 - Mobile QA Tester - IN-Person Interview (Manhattan, NY)Recently posted
Prohires · New York, NY · Hybrid 🇺🇸
TechnologySalary not listed - AN

QUALITY ASSURANCE SPECIALIST with Security ClearanceRecently posted
Army National Guard Units · Rickenbacker AFB, OH · Remote 🇺🇸
Technology$64.4k - $83.7k/yr - MT

QA Automation EngineerRecently posted
Mersoft Technology LLC · Houston, TX · Hybrid 🇺🇸
Stakeholder ManagementSQLJenkins+5TechnologySalary not listed