Haystack
← Back to Jobs
Engineering
QI

AI/LLM Engineer

Quality IT Source, LLCUnited States🇺🇸United StatesPosted Oct 8, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
United States
Posted
21 hours ago

Job Description

Required Qualifications

  • 6–8 years of software engineering experience, with at least 2 years building with LLMs or applied ML in production.
  • Strong proficiency in Python (or comparable) and strong engineering fundamentals — testing, version control, clean and maintainable code.
  • Deep hands-on experience with RAG systems: embeddings, vector databases, chunking/indexing, and a strong track record diagnosing and improving retrieval quality.
  • Experience designing and building data ingestion/ETL pipelines over large, messy, real-world datasets.
  • Strong experience integrating third-party APIs into backend services, including authentication flows (OAuth/SSO) and webhook/event-driven patterns.
  • Hands-on experience with LLM APIs (e.g., Anthropic, OpenAI, or similar) and orchestration frameworks.
  • Experience building and relying on evaluations for model and retrieval outputs.
  • Experience with knowledge graphs or entity-relationship modeling for retrieval.
  • Experience building multi-user or multi-tenant systems with scoped permissions and audit requirements.
  • Familiarity with observability and tracing for LLM or data pipelines.

Similar jobs