Back to Jobs
Recently postedOther

AI Gateway Engineer

Resource LogisticsMilpitas, CA🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeHybrid
LocationMilpitas, CA, United States
OnboardingAWSLoad BalancingLLMGenerative AIAzureIAM

Job description

Key Responsibilities

AI Gateway Platform Engineering

  • Design and implement enterprise AI Gateway platforms for GenAI, Agentic AI, and LLM workloads.
  • Build and manage centralized ingress and egress gateways for AI applications, agents, MCP servers, and external AI services.
  • Develop AI traffic routing, model orchestration, load balancing, failover, and request governance capabilities.
  • Implement model abstraction layers supporting multiple AI providers including OpenAI, Azure OpenAI, Anthropic, Google Gemini, AWS Bedrock, and private models.
  • Design multi-tenant AI platform architectures for enterprise consumption.
  • Establish AI service onboarding standards and platform governance processes.

Experience

  • 7+ years in Platform Engineering, Cloud Engineering, Security Engineering, or IAM.
  • 3+ years in AI/GenAI platform implementation.
  • Experience deploying enterprise AI solutions in production environments.
  • Strong exposure to secure software development and cloud-native architectures.

Similar jobs