Technology

Principal AI Engineer/AI Forward Development Engineer

Metalight Solutions IncNew York, NY🇺🇸United States

Why this role stands out

This Principal AI Engineer role offers a dynamic opportunity to architect and build the core execution layer for enterprise AI agents, enabling you to shape the future of AI-driven workflows. If you have a strong background in distributed systems and AI applications, and thrive in a collaborative, hybrid environment, this position is ideal for you to drive innovation and advance your career.

Quick overview

SeniorityLeader

Work modeHybrid

LocationNew York, NY, United States

MicroservicesKubernetesLLM

Job description

Position Overview
We are seeking a Senior AI / Agent Platform Engineer to build the execution layer powering enterprise AI agent capabilities. This role focuses on designing scalable runtime services and distributed systems that support long-running AI workflows in secure production environments.

Key Responsibilities

Design and build runtime services for long-running, asynchronous AI workloads.
Develop model routing and abstraction layers across multiple LLM providers.
Implement tool invocation, execution state management, retries, checkpointing, and failure recovery.
Build APIs and SDKs enabling reusable AI workflows.
Develop tracing, telemetry, and evaluation capabilities.
Collaborate with Security, Identity, and Platform Engineering teams.
Experience with Knowledgegraph

Required Qualifications

Strong software engineering and distributed systems background.
Experience building production AI applications using LLMs, AI Agents, Function Calling, or Workflow Orchestration.
Experience with asynchronous systems, queues, state management, retries, and observability.
Understanding of model APIs, structured outputs, prompt/context management, and AI performance optimization.
Cloud-native development experience (Containers, APIs, Kubernetes, Microservices).