Quick overview
Job description
Responsibilities
-
Define technical strategy and architecture for large-scale LLM, agent, retrieval, and AI platforms at the company level.
-
Establish reusable patterns for agent graphs, MCPs, orchestration, state management, memory, context engineering, tool use, and multi-agent systems.
-
Define standards for prompting, model selection, routing, structured outputs, guardrails, and failure recovery.
-
Design strategies for memory, personalization, conversation history, summarization, retrieval, and data retention across AI systems.
-
Establish model-selection frameworks that balance quality, latency, cost, context requirements, safety, and reliability.
-
Lead the design and adoption of AWS AI capabilities, including Amazon Bedrock and AgentCore.
-
Define evaluation methodologies and quality standards for AI systems, including offline evaluations, online metrics, human review, regression testing, and production feedback loops.
-
Establish observability standards for agent traces, tool calls, state transitions, memory access, model behavior, latency, cost, and failures.
-
Drive technical decisions related to reliability, security, privacy, governance, performance, and responsible AI.
-
Investigate complex AI failures and distinguish model limitations from issues in prompting, orchestration, memory, retrieval, tooling, or application design.
-
Build reusable AI platforms, frameworks, and engineering practices that enable software engineers to develop AI applications effectively.
-
Identify high-leverage opportunities to apply AI to customer and business problems.
-
Influence product and engineering roadmaps through deep technical expertise and business context.
-
Mentor AI engineers and software engineers working on AI-enabled products.
-
Resolve ambiguous, high-risk technical challenges and unblock multiple teams.
-
Communicate AI architecture, tradeoffs, limitations, and technical strategy clearly to engineering and business stakeholders.
Qualifications
-
6+ years of experience in software engineering or related fields, including 4+ years with AI, data science, or related technologies.
-
Expert proficiency in Python or a similar programming language.
-
Strong working knowledge of Node.js and JavaScript or TypeScript.
-
Demonstrated experience defining and scaling production AI or generative AI systems across multiple teams or products.
-
Deep expertise in LLM behavior, agent architecture, prompting, context engineering, state management, memory, tool use, retrieval, and model evaluation.
-
Experience designing agentic platforms, orchestration frameworks, or multi-agent systems.
-
Strong experience with AWS AI services, including Amazon Bedrock, AgentCore, or equivalent platforms.
-
Deep understanding of AI evaluation, observability, safety, reliability, governance, and responsible AI.
-
Strong background in distributed systems, backend architecture, cloud platforms, and production operations.
-
Ability to diagnose complex AI behavior using experiments, traces, evaluations, and production data.
-
Experience creating reusable AI frameworks and standards that allow other engineers to build safely and effectively.
-
Experience influencing technical strategy across multiple teams or product areas.
-
Proven ability to lead through ambiguity, make sound tradeoffs, and deliver measurable outcomes.
-
Exceptional communication, mentoring, and stakeholder-management skills.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- B2
Senior Software Development Manager - R01573809Recently posted Auto Apply
Brillio 2 · Bengaluru · Hybrid · Posted 17 Nov 2026 🇮🇳
DockerMicroservicesAWS+10TechnologySalary not listed - B2
Senior Tech Specialist, DevOps - R01573840Recently posted Auto Apply
Brillio 2 · Bengaluru · Hybrid · Posted 17 Nov 2026 🇮🇳
DockerGitAWS+16TechnologySalary not listed - B2
Software Development Lead - R01573881Recently posted Auto Apply
Brillio 2 · Bengaluru · Hybrid · Posted 17 Nov 2026 🇮🇳
Case ManagementComplianceSalesforce Service Cloud+2TechnologySalary not listed - AC

Intermediate Desktop Support (INDIA)Recently posted Auto Apply
Achievers · Chennai · Hybrid · Posted 17 Nov 2026 🇮🇳
OnboardingMicrosoft OfficeActive Directory+2TechnologySalary not listed - CI
Pega CSSA Developer - Constellation / Customer ServiceRecently posted Auto Apply
Credera India · Bengaluru · Hybrid · Posted 17 Nov 2026 🇮🇳
SQLScrumArticulate+7TechnologySalary not listed - AR

People Analytics Data ScientistRecently posted Auto Apply
Arrive · Bengaluru · On-site · Posted 17 Nov 2026 🇮🇳
Workforce PlanningWorkdaySQL+10TechnologySalary not listed - PE

Senior Software Engineer (Mainframe, Java) Akana Sola Auto Apply
Perforce · Pune · Hybrid 🇮🇳
DockerMySQLOracle+16TechnologySalary not listed - EX

System Engineer- Chennai, IndiaRecently posted Auto Apply
Exasol · Chennai · Hybrid · Posted 17 Nov 2026 🇮🇳
WorkdayShellTCP/IP+3TechnologySalary not listed - EX

Database Support Engineer (DSE, Senior) - Chennai, IndiaRecently posted Auto Apply
Exasol · Chennai · Hybrid · Posted 11 Nov 2026 🇮🇳
OnboardingWorkdayLua+6TechnologySalary not listed - ON

Lead Quality Assurance EngineerRecently posted Auto Apply
Onit · Pune · On-site · Posted 16 Nov 2026 🇮🇳
SQLGitScrum+11TechnologySalary not listed - WA

Senior Staff System engineerRecently posted Auto Apply
Wabtec · Bengaluru, KA · On-site · Posted 17 Nov 2026 🇮🇳
Stakeholder ManagementEmbedded SystemsDiversity & Inclusion+2TechnologySalary not listed - CO
EMEA SAP Functional Analyst – Finance O2C | BangaloreRecently posted Auto Apply
Colliers · Bengaluru, KA · On-site · Posted 17 Nov 2026 🇮🇳
Stakeholder ManagementJiraAgile+1TechnologySalary not listed
