Haystack
← Back to Jobs
Technology
IN

AI Architect

InfiCareDurham, NC🇺🇸United StatesPosted Oct 2, 2026

Why This Role Stands Out

This hybrid AI Architect role offers a fantastic opportunity to shape the future of AI development, working with cutting-edge multi-agent frameworks and LLM technologies within a reputable company. You'll thrive here if you possess strong architectural experience and a passion for building scalable, innovative AI systems, contributing to impactful projects while enjoying the flexibility of a hybrid work model.

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Durham, NC, United States
Posted
17 hours ago
DockerAWSAzureGoogle CloudKubernetesLLMPythonTypeScript

Job Description

Job Title: AI Architect

Location: North Carolina (Hybrid – 3 days in office)

Job Type: Contract

Experience: 10+ years of software architecture experience, with 3+ years hands-on in production LLM/AI systems

Job Overview

 

Key Responsibilities

  • Design and implement multi-agent orchestration frameworks including autonomous negotiation, task delegation, state management, and secure inter-agent communication
  • Architect and build scalable Model Context Protocol (MCP) servers and clients to connect LLMs to data sources, tools, and enterprise environments
  • Drive the architectural vision for an internal AI development platform (high throughput, low latency, seamless developer workflows)
  • Write production-ready code, build prototypes, and establish engineering best practices for AI application development
  • Standardize architectural patterns organization-wide; mentor junior engineers; communicate technical concepts to non-technical stakeholders

Required Skills

 
  • Multi-agent frameworks: LangGraph, AutoGen, CrewAI
  • Model Context Protocol (MCP) or similar context-sharing/tool-calling protocols
  • RAG pipelines, vector databases, prompt engineering
  • Programming: Python, TypeScript, or Go
  • Cloud-native: AWS, Google Cloud Platform, or Azure; Kubernetes, Docker
  • Modern AI SDKs and LLM application development

Preferred Skills

 
  • Experience authoring architecture RFCs and leading technical design reviews
  • Background in AI platform engineering and developer tooling

Location & Work Model

 

North Carolina — Hybrid (3 days per week in office required)

Engagement Details

 

Contract engagement. Immediate start preferred.

Similar jobs