AI Automation Engineer LLM Evaluation, Onsite - 70000

AI Automation Engineer LLM Evaluation, Onsite

We have an immediate need for an experienced AI Test Automation Engineer with strong expertise in GenAI, Agentic AI, LLM evaluation, and Python-based test automation to design and build end-to-end AI testing frameworks.

This is an onsite position based in Bellevue, WA for a candidate with strong hands-on experience in LLM evaluation frameworks such as Promptfoo, DeepEval, and Ragas, along with Python automation using PyTest and Unittest. The ideal candidate will have experience developing automated test cases, validating LLM/model outputs against quality benchmarks, evaluating relevance, groundedness, and hallucination, and integrating AI evaluation pipelines into CI/CD workflows.

For immediate consideration, please contact:
Pankaj
PRIMUS Global Services
Phone: Desk Ext. 214
Email: