← Back to Jobs
Other
AI Agentic Tester
Galaxy i Technologies, Inc.United States🇺🇸United StatesPosted 10 Aug 2026
Quick Overview
Work Type
Hybrid
Level
Mid Senior
Job Description
Job Title: AI Agentic Tester
Location: Denver, CO (Zip Code: 80221)- REMOTE
Location: Denver, CO (Zip Code: 80221)- REMOTE
Role: AI Agentic Tester
Skills: QA/Test Engineering experience
Must have: Experience testing Generative AI, LLM, or AI-based applications.
Role Description: AI Agentic Tester
Essential Skills: AI Agentic Tester
Desirable Skills:
Keyword:
Skills: Modern Functional Quality Engineering
Experience Required: 2-4 Years
PFB the responsibilities and skills needed:
Functional Testing
Validate AI agent workflows against business requirements.
Test end-to-end AI use cases, including multi-agent interactions.
Verify task completion accuracy and output quality.
Test agent orchestration, tool calling, and workflow execution.
AI Model Validation
Evaluate LLM responses for accuracy, relevance, and consistency.
Test prompt engineering effectiveness and response quality.
Validate Retrieval-Augmented Generation (RAG) outputs.
Measure hallucination rates and response reliability.
Required Skills
3-8 years of QA/Test Engineering experience.
Experience testing Generative AI, LLM, or AI-based applications.
Knowledge of AI Agents, Agentic AI, RAG, and prompt engineering.
Hands-on experience with API testing (Postman, Swagger, REST APIs).
Experience with automation frameworks (Selenium, Playwright, PyTest).
Proficiency in Python.
Understanding of AI evaluation metrics and testing methodologies
Knowledge of Azure OpenAI, AWS Bedrock, Gemini, or similar AI platforms
Skills: QA/Test Engineering experience
Must have: Experience testing Generative AI, LLM, or AI-based applications.
Role Description: AI Agentic Tester
Essential Skills: AI Agentic Tester
Desirable Skills:
Keyword:
Skills: Modern Functional Quality Engineering
Experience Required: 2-4 Years
PFB the responsibilities and skills needed:
Functional Testing
Validate AI agent workflows against business requirements.
Test end-to-end AI use cases, including multi-agent interactions.
Verify task completion accuracy and output quality.
Test agent orchestration, tool calling, and workflow execution.
AI Model Validation
Evaluate LLM responses for accuracy, relevance, and consistency.
Test prompt engineering effectiveness and response quality.
Validate Retrieval-Augmented Generation (RAG) outputs.
Measure hallucination rates and response reliability.
Required Skills
3-8 years of QA/Test Engineering experience.
Experience testing Generative AI, LLM, or AI-based applications.
Knowledge of AI Agents, Agentic AI, RAG, and prompt engineering.
Hands-on experience with API testing (Postman, Swagger, REST APIs).
Experience with automation frameworks (Selenium, Playwright, PyTest).
Proficiency in Python.
Understanding of AI evaluation metrics and testing methodologies
Knowledge of Azure OpenAI, AWS Bedrock, Gemini, or similar AI platforms
Skills
AWS
Selenium
Azure
Generative AI
LLM
Playwright
Postman
Python
REST
pytest
Similar jobs
Senior Director, Enterprise Data & Analytics - Onsite
Genesis10 · Minneapolis, United States
7 minutes ago$225k/yrApplication Architect
Genesis10 · Plano, United States
9 minutes ago$64 - $72/hrMobile Sanitization Technician - Onsite
Genesis10 · Columbus, United States
9 minutes ago$20/hrData Science Manager
Credence Management Solutions · Wright-Patterson Air Force Base, United States
12 minutes agoBusiness Foundations Career Training Opportunity
Year Up United · Seattle, United States
12 minutes ago$525/moL1 desktop support| M365 Support_Onsite@Regina, Saskatchewan, Canada
BURGEON IT SERVICES LLC · Regina, United States
13 minutes ago