Haystack
← Back to Jobs
Technology

Applied AI Engineer - NYC, NY (Locals Preferred)

KE StaffingNew York, NY🇺🇸United StatesPosted 22 Jul 2026

Why This Role Stands Out

This hybrid role offers a fantastic opportunity to lead the development and deployment of cutting-edge GenAI solutions, pushing the boundaries of AI orchestration frameworks. You'll thrive here if you have extensive experience building and operating production-grade GenAI platforms and possess strong LLMOps expertise, contributing to impactful projects within a reputable company.

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

  • 5+, dedicated experience in practical application of GenAI solutions in an enterprise business environment. Designing and operating GenAI orchestration frameworks in production beyond vendor examples (e.g., LangChain systems).
  • 5+ years of strong front-to-back engineering experience, focusing on AI/ML platforms and workflows (Python or Java).
  • Proven experience building and operating production-grade GenAI / LLM platforms, applying patterns such as RAG, tool/function calling, agentic workflows, and validated structured outputs.
  • Strong LLMOps expertise, including evaluation harnesses, prompt and version management, regression testing, observability, and reliability measurement in production systems.
  • Hands-on experience building AI-first data ingestion pipelines with measurable quality, accuracy, and reliability.
  • Advanced retrieval experience: advanced vector search, including multi-vector and late-interaction approaches (e.g., ColBERT, chunking), multi-stage retrieval pipelines, metadata filtering, re-ranking. Solid understanding of evaluation metrics and how they shape practical RAG system design (e.g., recall vs precision, latency vs quality, MRR, NDCG).

Experience operating GenAI systems through real production failures (model regressions, retrieval degradation, prompt drift, data quality issues) and designing mitigation strategies

Skills

Java
LLM
Python

Similar jobs