Haystack
← Back to Jobs
Technology
RT

Applied AI Engineer

Russell, Tobin & AssociatesNew York, NY🇺🇸United StatesPosted 31 Aug 2026

Why This Role Stands Out

This on-site Applied AI Engineer role offers a fantastic opportunity to leverage your Python, Generative AI, and prompt engineering expertise to build cutting-edge applications. You'll thrive here if you possess a curious mindset, strong communication skills, and a passion for solving complex AI challenges within a reputable organization. Apply now to contribute to impactful projects and further develop your skills in a dynamic environment.

Quick Overview

Seniority
Mid Senior
Work mode
On Site
Location
New York, NY, United States
Posted
22 hours ago
LLMPython

Job Description


Role: Applied AI Engineer
Location: New York, NY (1633 Broadway)
Hybrid: 3x
Duration: 12 Month + Extension/ Contract to Hire

Interview Process: 
1.) Zoom
2.) Onsite Interview (90 Mins)

Years of experience: 5-7 Years Exp (More is Okay)
 
Must: (5- 7 Years Exp)
  • Great hands on experience coding within Python
  • Good hands on Core AI experience 
  • Good GenAi and Agentic AI exp 
  • How it works, how information can be extracted, prompt engineering, etc
  • Practical experience building applications using Python, OpenAI or Claude Agent SDK and other agentic frameworks (comparable LLM APIs).
  • Strong understanding of prompt engineering, including prompt design, prompt testing, grounding, context management, and output validation.
  • Experience building AI or data-driven applications that use APIs, databases, cloud services, and enterprise data sources.
  • Good exp in frontier CodingTools: ClaudeCode - Amp - CodeEx, etc
  • Strong RAG Experience - What is needed to implement 
  • Has working experience working on complex systems and building complex applications 
  • PostGres Exp 
  • Although different Vector Database will suffice 
  • Fantastic Communication skills
  • Curious mindset
  • Strong Communication (Written and Verbal) 
  • Know what they are doing, why they are doing it. 

Plusses:
  • Financial Services Experience (Great if they work with Fixed Income - What is a stock, what is a bond, etc)
  • Elastic Search Exp 
  • Embedding Exp
 
Misc:
  • Doc Central - Massive document repository within the firm 
  • Becoming the FIRMS main AI solution for document extraction, summarization and search engine for internal documents 
  • DocCentral is about 20% of the OpenAI traffic through MS
  • Doc Central: RAG Millions of Documents 
  • This person will be using RAG, but also helping build out different capabilities as they scale 
  • Moved on from Trad RAG, going more Agentic 
  • Evaluation is also a big component of what they do

Similar jobs

Browse related jobs

Apply now