Haystack
← Back to Jobs
Engineering

AI/LLM Engineer

TATA Consultancy Services LimitedNew York, NY🇺🇸United StatesPosted 10 Aug 2026

Quick Overview

Work Type
On Site
Level
Mid Senior

Job Description

Job Title- AI/LLM Engineer
 
Work Location (State, City and Zip)1633 Broadway, New York, NY 10019, USA– Need to work from office 3 Days a week. Also need to come office for F2F Round
Base salary range (Min. & Max. to be mentioned)$120-130k per 
Experience Range: 8-10 years
 
 
Must Have Technical/Functional Skills
We are looking for a highly skilled AI/LLM Engineer to design and build intelligent agent-based systems that can reason, plan, and act autonomously. The role requires strong Python engineering expertise and hands-on experience with modern agent frameworks, along with a solid understanding of data platforms and scalable architectures.
________________________________________
Key Responsibilities
Agent & AI System Development
• Design and build agent-based systems using frameworks such as LangChain, LangGraph, or similar
• Develop intelligent components capable of reasoning, planning, and executing tasks autonomously
• Implement advanced cognitive patterns such as ReAct (Reasoning + Acting)
LLM Capabilities & Enhancements
• Develop and integrate memory, tool usage, and context management capabilities (MCP)
• Build systems that leverage tool calling, chaining, and orchestration of LLM workflows
• Collaborate with prompt engineers to enhance model responses and performance
Engineering & Development
• Write high-quality, scalable code using Python (including async programming)
• Build and maintain APIs and microservices for AI/agent-based applications
• Ensure systems are efficient, reliable, and production-ready
Guardrails & Responsible AI
• Design and implement guardrails and safety mechanisms for LLM-driven systems
• Ensure robust handling of edge cases, failure scenarios, and unintended outputs
Data & Platform Integration
• Work with modern data platforms such as: 
o Snowflake
o Databricks
o Lakehouse architectures
• Integrate AI solutions with enterprise data pipelines and systems
 

Candidate had to go Onsite for 1 round of interview at -379 Thornall St, Edison, NJ 08837

Candidate had to go Onsite for client round of interview at-1633 Broadway,New York, NY 10019

Need to work from office 3 Days a week.

Only Proceed if you agree with all terms

 

Similar jobs