Quick Overview
Seniority
Leader
Work mode
Hybrid
Location
New York, NY, United States
Posted
Yesterday
MicroservicesKubernetesLLM
Job Description
Position Overview
We are seeking a Senior AI / Agent Platform Engineer to build the execution layer powering enterprise AI agent capabilities. This role focuses on designing scalable runtime services and distributed systems that support long-running AI workflows in secure production environments.
Key Responsibilities
- Design and build runtime services for long-running, asynchronous AI workloads.
- Develop model routing and abstraction layers across multiple LLM providers.
- Implement tool invocation, execution state management, retries, checkpointing, and failure recovery.
- Build APIs and SDKs enabling reusable AI workflows.
- Develop tracing, telemetry, and evaluation capabilities.
- Collaborate with Security, Identity, and Platform Engineering teams.
- Experience with Knowledgegraph
Required Qualifications
- Strong software engineering and distributed systems background.
- Experience building production AI applications using LLMs, AI Agents, Function Calling, or Workflow Orchestration.
- Experience with asynchronous systems, queues, state management, retries, and observability.
- Understanding of model APIs, structured outputs, prompt/context management, and AI performance optimization.
- Cloud-native development experience (Containers, APIs, Kubernetes, Microservices).
Similar jobs
- CA
AI Developer - Python - Google Cloud Platform
NewCapgemini America, Inc.
United States🇺🇸$68.9k - $161.5k/yrHybrid14 hours agoSQLMachine LearningBigQuery+3Technology - AP
AWS AI Developer
NewApexon
Detroit, MI🇺🇸Hybrid14 hours agoFastAPIAPI GatewayAWS+5Technology - BA
Lead Enterprise Cybersecurity Artificial Intelligence Engineer
NewBooz Allen Hamilton
McLean, VA🇺🇸$128.7k - $292k/yrOn-site14 hours agoSQLELKMachine Learning+4Technology - BA
Computer Vision AI Engineer
NewBooz Allen Hamilton
McLean, VA🇺🇸$99k - $225k/yrOn-site14 hours agoEmbedded SystemsMachine LearningCUDA+5Technology - ID
GenAI Engineer
NewIDR, Inc.
Nashville, TN🇺🇸Hybrid14 hours agoAWSMachine LearningGenerative AI+1Technology - SA
Staff Applied AI Engineer - Enterprise AI Solutions
NewSnorkel AI
New York City🇺🇸Remote10 hours agoFastAPIMachine LearningScikit-learn+8Technology