Haystack
← Back to Jobs
Technology
SC

AI Engineer

S3 Connections LLCNew York, NY🇺🇸United StatesPosted Sep 22, 2026

Why This Role Stands Out

This hybrid AI Engineer role offers exciting opportunities to develop cutting-edge GenAI solutions within a reputable company, perfect for experienced engineers passionate about RAG and advanced retrieval systems. You'll thrive here if you possess strong Python or Java skills and a proven track record in production enterprise environments, so don't miss this chance to advance your career.

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
New York, NY, United States
Posted
21 hours ago
JavaPython

Job Description

Key Requirements:

  • 5+ years of strong software engineering experience with Python or Java
  • 2+ years of hands-on GenAI experience in production enterprise environments
  • Strong hands-on experience designing and implementing RAG and advanced retrieval systems
  • Experience with embeddings, vector databases, chunking, semantic/hybrid search, metadata filtering, and re-ranking
  • Experience with multi-stage/multi-vector retrieval, ColBERT or late-interaction approaches
  • Hands-on agentic workflows, tool/function calling, structured outputs, and GenAI orchestration
  • Strong LLMOps experience including evaluation, prompt/version management, regression testing, observability, monitoring, and feedback loops
  • Experience building AI document ingestion and extraction pipelines with validation, confidence scoring, traceability, and human-in-the-loop review
  • Experience troubleshooting production issues involving hallucinations, retrieval degradation, model regressions, prompt changes, data quality, latency, and reliability
  • Strong architecture/system design skills and ability to explain technical implementations and trade-offs
  • Experience building AI solutions from the ground up, rather than primarily consuming prebuilt AI APIs

Similar jobs