Haystack
← Back to Jobs
Technology

Gen AI Architect

Jean Martin, IncCharlotte, NC🇺🇸United StatesPosted 13 Aug 2026

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Required Skills

  • 10+ years of experience in software architecture, AI/ML, or enterprise application development.
  • 3+ years of hands-on experience with Generative AI / LLM technologies.
  • Strong understanding of LLMs, transformers, embeddings, tokenization, prompt engineering, and RAG.
  • Hands-on experience with AI Agents / Agentic AI and tool/function calling.
  • Strong programming experience in Python and/or Java/.NET.
  • Experience with LangChain, LangGraph, LlamaIndex, Semantic Kernel, or equivalent frameworks.
  • Strong experience with REST APIs, microservices, event-driven architecture, and distributed systems.
  • Experience with vector databases and enterprise search technologies.
  • Strong knowledge of Azure OpenAI / AWS Bedrock / Google Vertex AI or similar cloud AI services.
  • Experience with Docker, Kubernetes, CI/CD, and cloud-native architectures.
  • Strong understanding of data engineering, SQL/NoSQL databases, and data pipelines.
  • Knowledge of AI security, including prompt injection, data leakage, access control, and AI guardrails.
  • Experience with LLM evaluation, observability, monitoring, and AI governance.

Skills

Docker
Microservices
SQL
AWS
Azure
Generative AI
Java
Kubernetes
LLM
Python
REST

Similar jobs