Haystack
← Back to Jobs
Remote
Technology

AI Automation engineer

QUANTUM TECHNOLOGIES LLCUnited States🇺🇸United StatesPosted 6 Aug 2026

Quick Overview

Salary
€83/hr
Work Type
Remote
Level
Mid Senior

Job Description

Job Title: AI Automation engineer

Location: Remote

Duration: 12 Months + Extension

Bill Rate: $83/hour

Job Type: C2C/1099 Contract

Client: To Be Discussed Later

Work Authorization:

  • USC
  • GC
  • H-1B
  • OPT-EAD
  • GC-EAD
    Must have skills
    ETL Pipeline
    ML /AI
    AI Ops (ML Ops, Agent Ops & LLM Ops) Workflow
    Python , SQL
    System Design,
    MCP Client server design
    Job description:
    Design and build end-to-end AI testing frameworks covering unit, functional, integration, and regression testing including automated test case generation and model output validation against defined quality benchmarks.
    Develop load and performance testing simulating high-concurrency scenarios to validate scalability, latency SLAs, and platform stability under peak load.
    Build LLM evaluation pipelines covering relevance, groundedness, and hallucination metrics integrated into CI/CD workflows to enforce automated quality gates before every model or agent deployment.
    Own regression testing strategy across the AI platform maintaining automated suites that validate agent behavior, RAG pipeline accuracy, and API contracts after every release to prevent quality degradation.

    Equal opportunity Employer : We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Skills

SQL
ETL
LLM
Python

Similar jobs