Haystack
← Back to Jobs
Technology
MS

Senior AI / Agent Platform Engineer (Urgent Position)

Metalight Solutions IncNew York, NY🇺🇸United StatesPosted Oct 5, 2026

Quick Overview

Seniority
Mid Senior
Work mode
On Site
Location
New York, NY, United States
Posted
20 hours ago
MicroservicesKubernetesLLM

Job Description

Title: Senior AI / Agent Platform Engineer
Location: New York, NY
Employment Type: Full-Time
Work Model: Hybrid (3 Days Onsite)

Position Overview
We are seeking a Senior AI / Agent Platform Engineer to build the execution layer powering enterprise AI agent capabilities. This role focuses on designing scalable runtime services and distributed systems that support long-running AI workflows in secure production environments.

Key Responsibilities

  • Design and build runtime services for long-running, asynchronous AI workloads.
  • Develop model routing and abstraction layers across multiple LLM providers.
  • Implement tool invocation, execution state management, retries, checkpointing, and failure recovery.
  • Build APIs and SDKs enabling reusable AI workflows.
  • Develop tracing, telemetry, and evaluation capabilities.
  • Collaborate with Security, Identity, and Platform Engineering teams.
  • Experience with Knowledgegraph

Required Qualifications

  • Strong software engineering and distributed systems background.
  • Experience building production AI applications using LLMs, AI Agents, Function Calling, or Workflow Orchestration.
  • Experience with asynchronous systems, queues, state management, retries, and observability.
  • Understanding of model APIs, structured outputs, prompt/context management, and AI performance optimization.
  • Cloud-native development experience (Containers, APIs, Kubernetes, Microservices).

Similar jobs