Haystack
← Back to Jobs
Technology

Gen AI Architect with ML

Decision Six Inc.Chicago, IL🇺🇸United StatesPosted 29 Jul 2026

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Job Description :

  • We are seeking a highly skilled Solution Architect with over 7 years of experience in engineering and machine learning, including a minimum of 3 years in architecting and scaling production-grade AI systems.
  • The ideal candidate will have deep proficiency in cloud AI platforms and a strong understanding of generative AI architecture.
  • Responsibilities Design and implement scalable AI solutions using cloud platforms such as AWS, Azure, or Google Cloud Platform.
  • Architect and optimize generative AI systems, focusing on RAG, agentic workflows, and LLM orchestration.
  • Oversee model serving and inference frameworks to ensure high performance and reliability.
  • Manage AI data pipelines, feature stores, and vector databases to support data-driven decision-making.
  • Implement MLOps and LLMOps practices for model tracking, versioning, evaluation, and monitoring.
  • Utilize DevOps practices and Infrastructure as Code (IaC) to streamline AI infrastructure deployment.
  • Collaborate with cross-functional teams to deliver innovative AI solutions for B2B clients.
  • Mandatory Skills 7+ years of experience in engineering/ML with 3+ years as a Solution Architect.
  • Deep proficiency in AWS (SageMaker), Azure (OpenAI), or Google Cloud Platform (Vertex AI).
  • Expertise in generative AI architecture, including RAG and LLM orchestration (Lang Chain/LlamaIndex).
  • Strong knowledge of scalable inference and serving frameworks (vLLM, Triton, TGI).
  • Experience with AI data pipelines, feature stores, and vector databases (Pinecone, Milvus).
  • Proficiency in MLOps & LLMOps tools (MLflow, Lang Smith).
  • Hands-on experience with containerization (Kubernetes, Docker) and terraform.
  • Proven experience as a Solution Architect in a B2B environment.
  • Preferred Skills Experience with additional cloud platforms and AI tools.
  • Strong communication and leadership skills.
  • Ability to work in a fast-paced, collaborative environment.
  • Qualifications bachelor’s or master’s degree in computer science, Engineering, or a related field.
  • Relevant certifications in cloud platforms or AI technologies are a plus.

Skills

Docker
AWS
MLOps
MLflow
Machine Learning
Azure
Generative AI
Google Cloud
Kubernetes
LLM
Terraform

Similar jobs