Haystack
← Back to Jobs
Technology
AL

AI Platform Engineer – MCP / Model Gateway / GenAI

ALTCloud.aiUnited States🇺🇸United StatesPosted 3 Sept 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
United States
Posted
22 hours ago
AWSGitLLMPythonTypeScript

Job Description

AI Platform Engineer – MCP / Model Gateway / GenAI

Duration: 5 Months Contract
Location: Remote 
Experience: 8+ Years
Position: 1

Job Summary

We are looking for an AI Platform Engineer / GenAI Engineer to build and enable an enterprise AI development platform. The engineer will work hands-on with MCP (Model Context Protocol), AI-assisted development tools, AWS Bedrock, Anthropic, Cohere, SageMaker, Python, TypeScript, and agentic AI orchestration.

The ideal candidate has experience building shared AI services/gateways used by multiple development teams and has practical experience integrating AI coding assistants into software development workflows.

Key Responsibilities

  • Configure and enable enterprise AI-assisted development tools such as Kiro, Amazon Q Developer, Cursor, Claude Code, or GitHub Copilot.
  • Establish AI-assisted, spec-driven software development workflows including requirements, specifications, design, tasks, testing, coding and review.
  • Build and integrate MCP (Model Context Protocol) servers, including tools, APIs, configurations and enterprise system integrations.
  • Develop a centralized Model Gateway supporting routing across AWS Bedrock, Anthropic, Cohere and custom Amazon SageMaker endpoints.
  • Implement centralized AI guardrails, throttling, rate limiting and PII/PHI filtering.
  • Implement usage tracking, telemetry, cost allocation and application/department-level attribution.
  • Build reusable agentic AI orchestration and prompt management accelerators.
  • Support AI workflow automation use cases such as meeting summarization, ticket creation and request routing.
  • Define and implement security and quality gates within AI-assisted development workflows.
  • Measure AI development productivity and workflow metrics and demonstrate measurable improvements.
  • Train and enable internal engineering teams to independently use the AI development lifecycle and platform.

Required Qualifications

  • 4+ years of professional software engineering experience.
  • Strong experience with Python and TypeScript.
  • Strong Git, CI/CD and modern software development practices.
  • Hands-on experience with one or more AI-assisted development platforms such as:
    Kiro, Amazon Q Developer, Cursor, Claude Code, or GitHub Copilot.
  • Practical experience with Model Context Protocol (MCP), including building or integrating MCP servers and defining tools.
  • Experience designing and developing APIs and enterprise integrations.
  • Experience building shared services, platforms or gateways consumed by multiple teams.
  • Experience with cloud-based AI/GenAI applications, preferably AWS.

Preferred Qualifications

  • Experience with AWS Bedrock and multi-model AI architectures.
  • Experience with LiteLLM, Bedrock Gateway or comparable model-routing platforms.
  • Experience with Anthropic, Cohere and SageMaker endpoints.
  • Agentic AI experience including tool calling, multi-step orchestration and agent evaluation.
  • Experience with AI guardrails, PII/PHI protection, rate limiting and AI observability.
  • Experience defining developer productivity metrics or implementing AI-assisted development programs.
  • Experience providing technical training or developer enablement.
  • Experience working in regulated industries or public-sector environments.

Key Technologies

Python | TypeScript | MCP | AWS Bedrock | SageMaker | Anthropic | Cohere | LiteLLM | Kiro | Amazon Q Developer | Cursor | Claude Code | GitHub Copilot | Agentic AI | RAG | APIs | CI/CD | Git | AI Guardrails | AI Gateway | Model Gateway

Ideal Candidate

The ideal candidate is a hands-on GenAI/AI Platform Engineer who has moved beyond basic LLM application development and has experience building the platform, gateways, tooling and developer workflows that allow other engineers to safely build and deploy AI applications at enterprise scale.

Similar jobs