Quick overview
Job description
WHAT YOU'LL DO
-
Build and deploy AI agents using modern agent SDKs (Claude, OpenAI, or similar) with custom tools and function calling
-
Design and build tool harnesses and execution environments for agents—both on desktop (local CLI, IDE integrations) and in the cloud (containerized, API-driven)
-
Partner with internal teams across the organization to understand their workflows, identify automation opportunities, and build agents tailored to their use cases
-
Think critically about LLM capabilities and limitations—understand the differences between models, when to use which, and how to get the best results from each
-
Develop context engineering strategies—understanding how to give LLMs the right information at the right time within token limits
-
Build and maintain custom tool libraries that agents can use to interact with internal systems, APIs, and data sources
-
Deploy and manage agents in cloud environments with proper monitoring, error handling, and cost controls
-
Optimize LLM costs and performance through prompt engineering, caching, and smart model selection
WHO YOU ARE
- You’ve built AI agents and shipped them to production—not just prototypes
-
You’ve deployed agents in cloud environments and dealt with the real-world challenges that come with it
-
You’ve built tools, harnesses, or scaffolding that agents use to accomplish tasks
-
You use Claude Code and Cursor daily—you’re deeply comfortable with AI-assisted development, including headless mode, multi-file editing, and MCP server integration
- You think critically about LLMs—you understand how they work under the hood, not just how to call an API
- You understand the differences between models (Claude, GPT, Gemini, open-source) and can reason about which to use for a given task
- You have strong product sense—you focus on what users actually need, not just what’s technically interesting
- You’re pragmatic—you ship 80% solutions quickly and iterate based on feedback
- You can sit with a non-technical team, understand their pain points, and translate that into an agent that actually helps
- You take ownership and drive things from idea to measurable impact
- You communicate clearly—you can explain complex AI systems to anyone in the company
- You stay current with the rapidly evolving AI landscape and bring new ideas to the team
- You’re comfortable working across cloud platforms (GCP, AWS, Azure) and containerized environments
- Experience with advanced agent patterns or multi-agent systems
- Experience building and configuring MCP (Model Context Protocol) servers
- Open-source contributions to AI/ML projects
- Familiarity with observability tools for LLM applications
- Media, ad tech, or streaming data domain knowledge
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- CO

Senior Deployment Engineer - LLM Inference & OptimizationRecently posted Auto Apply
CoreWeave · Bellevue · Hybrid · Posted 14 Nov 2026 🇺🇸
SpringCUDAHugging Face+4Technology$188k - $275k/yr - TT
Lead AI EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 14 Nov 2026 🇺🇸
DockerSQLGit+8Technology$175k - $300k/yr - TT
Founding AI Agent EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco Bay Area · On-site · Posted 14 Nov 2026 🇺🇸
RecruitingCRMClinical Trials+2$150k - $220k/yr - TT
Founding AI EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 13 Nov 2026 🇺🇸
Next.jsLLMPlaywright+2Technology$216k - $250k/yr - TT
AI SchedulerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 13 Nov 2026 🇺🇸
BIMConstruction ManagementPrimavera P6+2$140k - $200k/yr - TT
Member of Technical Staff, AI AgentsRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 13 Nov 2026 🇺🇸
LLMPythonTypeScript$150k - $300k/yr - FA

AI Engineer - SMERecently posted Auto Apply
Fantom Corporation · Chantilly · Hybrid · Posted 13 Nov 2026 🇺🇸
RecruitingDockerFastAPI+23TechnologySalary not listed - BE

AI Strategist Auto Apply
Beaconholdings · New York · On-site · Posted 5 Nov 2026 🇺🇸
ConcreteSalary not listed - BE

AI Strategist Auto Apply
Beaconholdings · San Francisco · On-site · Posted 5 Nov 2026 🇺🇸
ConcreteSalary not listed - EX
AI ManagerRecently posted Auto Apply
Expeditors · Columbus, OH · On-site · Posted 13 Nov 2026 🇺🇸
Microsoft OfficeSupply Chain ManagementGenerative AILogisticsSalary not listed - JM
AI Ops and Automation SpecialistRecently posted Auto Apply
Job Mobz · San Francisco, CA · Remote · Posted 13 Nov 2026 🇺🇸
BookkeepingSchedulingAdministrativeSalary not listed - SE
AI Identity InternRecently posted Auto Apply
ServiceNow · Kirkland, Washington · On-site · Posted 13 Nov 2026 🇺🇸
WorkdaySSOArticulate+5$59/hr