Haystack
← Back to Jobs
Other
MI

AI Gateway Engineer (Kong AI Gateway)

MindlanceJersey City, NJ🇺🇸United StatesPosted 26 Aug 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Jersey City, NJ, United States
Posted
Yesterday
AWSSnowflakeAzureOnboarding

Job Description

Hybrid onsite at Jersey City, NJ, 07310 / Dallas, TX, 75019 / Tampa, FL, 33647
CTH
2 round interview - zoom
Description:
We are seeking an experienced Senior AI Gateway Engineer to lead the architecture, engineering, security, and operational management of our enterprise AI Gateway platform with a primary focus on Kong AI Gateway.

This role will serve as the technical authority responsible for enabling secure, resilient, compliant, and scalable consumption of Large Language Models (LLMs), AI Agents, Retrieval Augmented Generation (RAG) services, Model Context Protocol (MCP) services, and Agent-to-Agent (A2A) communications across the enterprise.

The successful candidate will combine expertise in Kong AI Gateway, cloud architecture, AI security, identity and access management (IAM), resiliency engineering, and enterprise governance to deliver a highly available AI platform that meets the demands of a regulated financial services environment.

Key Responsibilities
AI Gateway Architecture & Engineering
Design, implement, and evolve enterprise AI Gateway solutions using Kong AI Gateway and Kong Enterprise.
Develop standardized onboarding patterns for applications, AI agents, and business services consuming AI.
Engineer reusable integration patterns for OpenAI, Azure OpenAI, AWS Bedrock, Anthropic, Snowflake Cortex, and internal and external AI services.
Implement intelligent model routing, failover, traffic shaping, and provider abstraction.
Develop custom Kong plugins and integrations supporting AI-specific governance and security requirements.
Define scalable control plane and data plane deployment architectures across hybrid and multi-cloud environments.

Required Qualifications
Education
Bachelor's degree in Computer Science, Cyber Security, Information Technology, Engineering, or related discipline.
Master's degree preferred.

Experience
8+ years of experience designing and operating enterprise API, application, or cloud platforms.
5+ years of experience in cloud architecture and security.
3+ years working with AI/ML platform technologies or enterprise AI deployments.
Hands-on experience implementing and managing Kong Gateway and Kong Enterprise solutions.
Experience within regulated industries such as financial services, banking, insurance, or capital markets strongly preferred.

Preferred Qualifications
Kong Certified Professional certification.
AWS Solutions Architect certification.

EEO

Mindlance is an

Equal Opportunity Employer and does not discriminate in employment on the basis of Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.

Similar jobs