Agentic AI Developer- Lead
Quick Overview
Job Description
Agentic AI Developer (Principal / Lead Level)
Role Summary
We are seeking a highly experienced Agentic AI Developer to design, build, evaluate, and optimize complex agentic AI systems for enterprise use cases. This role requires deep handson experience with multiagent architectures, strong judgment in model and system design, and the ability to continuously improve AI system performance aligned to business priorities.
This is a handson technical leadership role, not an executiononly developer position.
Key Responsibilities
Agentic AI System Design & Development
- Design and implement complex multiagent workflows using frameworks such as LangChain, LangGraph, CrewAI, Semantic Kernel, or equivalent.
- Architect agent systems that incorporate planning, memory, tool orchestration, feedback loops, and safe control flows.
- Own agent behavior endtoend, from prompt and tool design to runtime execution and iteration.
Evaluation & Performance Optimization
- Define and implement evaluation frameworks for agentic systems, including automated evaluation (e.g., LLMasjudge, metrics) and humanintheloop feedback.
- Analyze agent outputs to identify failure modes, inefficiencies, hallucinations, and quality gaps.
- Continuously enhance system performance across accuracy, latency, cost, reliability, and business impact.
Machine Learning & Model DecisionMaking
- Make informed decisions on model selection, architecture, and tradeoffs based on use case, constraints, and business goals.
- Identify model limitations, risks, and loopholes, and proactively mitigate them through design or experimentation.
- Optimize model and system performance based on business priorities, not just technical metrics.
Data & SQL Proficiency
- Use SQL confidently to analyze data, validate outputs, debug issues, and support evaluation and optimization efforts.
- Work independently across data sources without reliance on downstream teams for basic analysis.
CrossFunctional Collaboration
- Partner closely with product, business, and engineering stakeholders to translate business objectives into robust agentic AI solutions.
- Clearly communicate technical decisions, tradeoffs, and system behavior to both technical and nontechnical audiences.
Required Qualifications
- 8+ years of experience in AI/ML, data science, or backend engineering, with significant handson work in agentic or GenAI systems.
- Proven experience building productiongrade agentic AI systems, not just prototypes or demos.
- Strong understanding of:
- Multiagent architectures
- Prompt engineering and agent orchestration
- Evaluation methodologies for LLM and agentic systems
- Demonstrated ability to make independent architectural and model decisions.
- Strong SQL skills for data analysis and debugging.
- Proficiency in Python and modern AI/ML tooling.
Nice to Have
- Experience deploying agentic systems in enterprise or regulated environments.
- Exposure to MLOps, monitoring, and postdeployment optimization.
- Experience aligning AI system performance with business KPIs.
What This Role Is Not
- Not an entrylevel or learningonthejob agentic AI role
- Not an executiononly LangChain / promptengineering position
- Not a role where architectural decisions are fully prescribed by others
Skills
Similar jobs
AI Architect
Orion Business Innovations Careers · Plano, United States
49 minutes agoAI Engineer
Avenue Code, LLC · United States
49 minutes agoAI Architect
Coforge · Phoenixville, United States
51 minutes agoPrincipal AI Engineer
SOHO Square Solutions · United States
54 minutes agoAI Developer - (Infrastructure, Copilot, IaC), Onsite - 69343
PRIMUS Global Services Inc. · Fort Mill, United States
1 hour agoSenior AI Developer (Palantir AI Platform)
Vaco by Highspring · United States
1 hour ago$170k/yr