Haystack
← Back to Jobs
Remote
Technology
GD

AI Platform Engineer

GDHUnited States🇺🇸United StatesPosted 25 Aug 2026

Quick Overview

Salary
$80 - $94/hr
Seniority
Mid Senior
Work mode
Remote
Location
United States
Posted
Yesterday
DockerAWSMachine LearningScrumAgileAzureC#C++Generative AIGitHub ActionsGroovyJavaJavaScriptJenkinsKubernetesPythonStakeholder ManagementTypeScript

Job Description

Role Summary
We are seeking a highly experienced AI Platform Engineer with deep DevOps expertise to design, build, and operate enterprise AI and Generative AI platforms. This role involves leading the development of scalable, automated, and reliable AI infrastructure, supporting large language models, machine learning operations, and related technologies. The ideal candidate will focus on enhancing developer experience, governance, and operational excellence across the enterprise’s AI ecosystem.

Responsibilities

  • Develop continuous integration and continuous deployment pipelines utilizing GitHub Actions, Jenkins, TypeScript, Python, and Groovy.
  • Build scalable AI, Generative AI, large language model operations, and machine learning platforms.
  • Design and develop reusable services supporting retrieval augmented generation, prompt lifecycle management, vector search, AI gateways, inference APIs, and agentic AI capabilities.
  • Implement model deployment, monitoring, version management, evaluation frameworks, and governance controls.
  • Enable application development teams through DevOps coaching, platform enablement, and best practices for developer experience.
  • Evaluate emerging technologies through proof of concepts to drive automation, innovation, and platform improvements.
  • Partner with cross-functional teams to establish enterprise standards and best practices for AI platform engineering.
  • Ensure platform reliability, scalability, security, and operational excellence across the AI ecosystem.
  • Promote best practices in automation, governance, and technical innovation throughout the AI platform.
  • Drive continuous improvement in AI infrastructure and operational processes supporting enterprise AI initiatives.

Qualifications

  • 15+ years of overall technology experience, with strong software development lifecycle knowledge.
  • Minimum of 2 years of software development experience using Python, Java, JavaScript, TypeScript, C#, or C/C++.
  • Hands-on experience with Docker, Kubernetes, and CI/CD practices.
  • Proven experience supporting or building enterprise AI, Generative AI, machine learning, or distributed computing platforms.
  • Familiarity with AWS and/or Microsoft Azure cloud platforms.
  • Strong understanding of platform architecture, automation, and infrastructure as code principles.
  • Experience working within Agile and Scrum delivery methodologies.
  • Excellent communication, collaboration, and stakeholder management skills.
  • Ability to evaluate emerging AI technologies through proof of concepts.
  • Must be legally authorized to work in the United States.

Publishing Pay Range: $80.00 - $94.00 Hourly 

This is a fully remote role and can be performed from an approved location.

Similar jobs