Haystack
← Back to Jobs
Technology
CO

AI Engineer with Automation experience

ConnectedX, Inc.Seattle, WA🇺🇸United StatesPosted 27 Aug 2026

Quick Overview

Seniority
Mid Senior
Work mode
On Site
Location
Seattle, WA, United States
Posted
19 hours ago
LLM

Job Description

Need local to Seattle, WA who can able to attend Onsite interview.

Job Title: AI Engineer with Automation

Location: Seattle, WA Onsite

Duration: Long Term

Job Description:

  • Design and build end-to-end AI testing frameworks covering unit, functional, integration, and regression testing, including automated test case generation and model output validation.
  • Develop load and performance testing simulating high-concurrency scenarios to validate scalability, latency SLAs, and platform stability.
  • Build LLM evaluation pipelines covering relevance, groundedness, and hallucination metrics integrated into CI/CD workflows.
  • Own regression testing strategy across the AI platform, maintaining automated suites that validate agent behavior, RAG pipeline accuracy, and API contracts.

Similar jobs