Haystack
← Back to Jobs
Technology
CD

AI Engineer

Cloud Destinations LLCUnited States🇺🇸United StatesPosted Sep 16, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
United States
Posted
Yesterday
AirflowAzureDatabricksGitLLMPandasPython

Job Description

ition: AI Engineer

Location: Remote

Hiring Mode: 6 Months Contract

Job Description:

This is a hands-on engineering role focused on Python-based decision pipelines, business rule implementation, and CI/CD delivery. Strong experience with Databricks and Azure AI Foundry is essential for building scalable enterprise AI and data solutions. Exposure to enterprise AI or LLM capabilities, including OpenAI models, may occur when required, but the primary emphasis is on reliable, maintainable, production systems rather than experimentation or research.

Core Responsibilities:

  • Design, build, and support scalable Python-based processing and decisioning pipelines using Databricks, PySpark, and Pandas.
  • Develop and maintain enterprise data processing workflows within the Databricks platform.
  • Translate complex business rules and domain logic into clean, testable, and maintainable decisioning systems.
  • Build modular, reusable components suitable for orchestrated, production workflows.
  • Develop and integrate AI-powered solutions using Azure AI Foundry, including enterprise AI, OpenAI, and other LLM services when required.
  • Integrate enterprise AI or LLM services (including OpenAI models) when needed, including basic prompt/template configuration and structured output parsing.
  • Apply standard safety and compliance controls (e.g., PII handling, input/output validation).
  • Integrate internal and external APIs with robust error handling and retry strategies.
  • Implement data validation, structured logging, and monitoring to support production observability and troubleshooting.
  • Participate in Git-based development, including branching, pull requests, code reviews, and conflict resolution.
  • Build and maintain CI/CD pipelines in Azure DevOps, including release workflows and deployment monitoring.
  • Support and troubleshoot live production systems.

Required Skills & Experience

  • Strong, hands-on experience with Python engineering for production systems.
  • Hands-on experience with Databricks for enterprise data engineering, notebook development, and production data pipelines.
  • Hands-on experience with Azure AI Foundry for developing, deploying, and integrating enterprise AI solutions.
  • Advanced proficiency with PySpark and Pandas.
  • Proven experience implementing business rules, decision logic, or rule-driven systems.
  • Experience working with OpenAI, Agentic AI systems, or AI-assisted workflows.
  • Experience integrating and working with OpenAI or other large language models (LLMs) in enterprise applications.
  • Solid understanding of Git-based delivery models.
  • Hands-on experience with Azure DevOps, including CI/CD pipelines and deployment monitoring.
  • Experience supporting enterprise production workloads.

Nice to Have

  • Experience in utilities, energy, or other rules-heavy domains.
  • Familiarity with workflow orchestration tools (ADF, Airflow, etc.).

Prior exposure to applied AI systems in enterprise environments.

Similar jobs