Quick Overview
Seniority
Mid Senior
Work mode
On Site
Location
Seattle, WA, United States
Posted
19 hours ago
LLM
Job Description
Need local to Seattle, WA who can able to attend Onsite interview.
Job Title: AI Engineer with Automation
Location: Seattle, WA Onsite
Duration: Long Term
Job Description:
- Design and build end-to-end AI testing frameworks covering unit, functional, integration, and regression testing, including automated test case generation and model output validation.
- Develop load and performance testing simulating high-concurrency scenarios to validate scalability, latency SLAs, and platform stability.
- Build LLM evaluation pipelines covering relevance, groundedness, and hallucination metrics integrated into CI/CD workflows.
- Own regression testing strategy across the AI platform, maintaining automated suites that validate agent behavior, RAG pipeline accuracy, and API contracts.
Similar jobs
- BU
Senior AI & Platforms Engineer
BuzzClan LLC
Brooklyn, NY🇺🇸Hybrid6 days agoFastAPIMicroservicesMLOps+12Technology - NI
AI Transformation Strategist
NewNICE
USA - Remote🇺🇸RemoteYesterdayCompliancePMPPrince2 - NP
AI Strategy & Transformation Architect
NeuraFlash, Part of Accenture
Remote - United States🇺🇸Remote6 days agoAWSSalesforceAzure+5 - ME
AI Ops Lead - Forward Deploy
NewMercury
San Francisco🇺🇸Remote22 hours agoSQLCADCompliance+2 - SO
Principal AI Workflow Engineer
Solidigm
Rancho Cordova, CA🇺🇸$196.2k - $314k/yrOn-site1 month agoEmbedded SystemsMLOpsCordova+4 - PC
Python AI Developer
Pyramid Consulting, Inc.
Jersey City, NJ🇺🇸$60 - $65/hrOn-site4 weeks agoLLMPythonTechnology