Haystack
← Back to Jobs
Technology
IW

AI Engineer

Info Way SolutionsBoston, MA🇺🇸United StatesPosted 26 Aug 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Boston, MA, United States
Posted
Yesterday
DockerMicroservicesSQLAWSMLOpsMachine LearningSnowflakeAzureDatabricksDeep LearningGenerative AIGitGoogle CloudKubernetesLLMPyTorchPythonRESTTensorFlow

Job Description

Job Summary

We are seeking a highly skilled AI Engineer to design, develop, and deploy AI/ML solutions that solve complex business problems. The ideal candidate will have strong hands-on experience with Python, Machine Learning, Generative AI, LLMs, RAG, AI/ML frameworks, APIs, and cloud platforms.

The candidate will work closely with software engineers, data scientists, and business stakeholders to build scalable AI applications and integrate AI capabilities into enterprise products and platforms.

Key Responsibilities

  • Design, develop, and deploy AI/ML and Generative AI solutions for enterprise applications.
  • Develop AI applications using Python and modern AI/ML frameworks.
  • Build and integrate Large Language Model (LLM) applications using OpenAI, Azure OpenAI, or similar platforms.
  • Design and implement Retrieval-Augmented Generation (RAG) pipelines.
  • Develop AI agents and agentic AI workflows where applicable.
  • Work with vector databases and embedding models for semantic search and knowledge retrieval.
  • Develop and integrate REST APIs and microservices for AI applications.
  • Perform data preprocessing, feature engineering, model evaluation, and optimization.
  • Fine-tune or customize AI/ML models based on business requirements.
  • Implement prompt engineering techniques and evaluate LLM responses.
  • Build scalable and production-ready AI solutions using cloud platforms such as AWS, Azure, or Google Cloud Platform.
  • Containerize and deploy AI applications using Docker and Kubernetes.
  • Implement CI/CD pipelines for AI/ML applications.
  • Monitor model performance, application health, latency, and reliability.
  • Collaborate with software engineers, data scientists, product managers, and business teams.
  • Ensure AI solutions meet requirements for security, scalability, reliability, and responsible AI.

Required Skills

  • 5+ years of software engineering / AI/ML experience
  • Strong hands-on Python programming
  • Experience with Machine Learning and Deep Learning
  • Experience with Generative AI and LLMs
  • Strong understanding of RAG architecture
  • Experience with OpenAI / Azure OpenAI or equivalent LLM platforms
  • Experience with LangChain, LangGraph, LlamaIndex, or similar frameworks
  • Experience with REST APIs and microservices
  • Knowledge of vector databases such as Pinecone, Azure AI Search, Weaviate, Milvus, or FAISS
  • Experience with SQL and data processing
  • Experience with at least one cloud platform: AWS, Azure, or Google Cloud Platform
  • Knowledge of Docker and Kubernetes
  • Experience with Git and CI/CD

Preferred Skills

  • Experience building AI agents / Agentic AI
  • Experience with MCP (Model Context Protocol)
  • Experience with LLM evaluation and observability
  • Experience with fine-tuning, LoRA, or PEFT
  • Knowledge of PyTorch or TensorFlow
  • Experience with Databricks, Snowflake, or Spark
  • Experience with MLOps / LLMOps
  • Knowledge of prompt engineering and model optimization
  • Experience with enterprise AI security and governance

Similar jobs