Haystack
← Back to Jobs
Remote
Technology
EP

Agentic AI Solution Architect

Empower ProfessionalsUnited States🇺🇸United StatesPosted 26 Aug 2026

Why This Role Stands Out

Advance your backend engineering career with this hybrid role, where you'll leverage your Python, Flask, and SQL Server expertise to build scalable APIs and services. This is an excellent opportunity for experienced engineers who thrive on complex problem-solving and contributing to impactful technology solutions within a reputable company.

Quick Overview

Salary
$55 - $60/hr
Seniority
Mid Senior
Work mode
Remote
Location
United States
Posted
5 days ago
MicroservicesSpringSpring BootMachine LearningAzureGenerative AIJavaPythonReact

Job Description

Role: Agentic AI Solution Architect

Location: Remote

Duration: 12+ Months

 

Must Have:

  • Agentic AI Solution Architecture
  • LangGraph / Multi-Agent Orchestration Frameworks
  • Generative AI, LLMs, RAG & Prompt Engineering
  • Python Development
  • Azure OpenAI, Azure AI Search & Azure AI Services
  • API, Microservices & Event-Driven Architecture
  • Java/Spring Boot and React
  • OCR/IDP, Intelligent Automation & Workflow Engineering
  • AI / Generative AI
  • Intelligent Automation
  • Enterprise Digital Transformation
  • Document Processing & Workflow Automation
  • Supply Chain / Manufacturing experience is a plus

 

Must Have Certifications:

  • Azure AI Engineer Associate (Preferred)
  • Azure Solutions Architect Expert (Preferred)
  • AI/ML Certifications (Preferred)

 

Role Summary:

  • The Software Solution Architect II will lead the architecture, design, and delivery of enterprise-scale Agentic AI and Intelligent Automation solutions. This role is responsible for defining end-to-end architecture across AI services, agent orchestration, workflows, document processing, integrations, data platforms, security, observability, DevOps, and cloud-native deployment. The architect will work closely with business and technology stakeholders to translate requirements into scalable, secure, and production-ready solutions.

 

Responsibilities:

  • Own end-to-end architecture covering AI services, agent orchestration, workflows, document processing, integrations, data platforms, user interfaces, security, observability, DevOps, and deployments.
  • Translate business and non-functional requirements into solution architectures, data flows, deployment models, integrations, and technical standards.
  • Design and lead hands-on development of tool-using agents using LangGraph or equivalent agent orchestration frameworks.
  • Define agent roles, tools, memory, state management, routing, retries, fallback mechanisms, and workflow termination strategies.
  • Architect multi-agent systems for search, extraction, classification, conversational AI, recommendations, decision support, and workflow automation.
  • Design human-in-the-loop validation, approval workflows, escalations, governance controls, AI guardrails, confidence scoring, and responsible AI patterns.
  • Architect RAG solutions, semantic/vector search, prompt engineering frameworks, structured outputs, AI evaluation methodologies, and OCR/IDP pipelines.
  • Design API-first and event-driven integrations with enterprise applications, document repositories, email systems, external platforms, knowledge bases, and legacy systems.
  • Guide Azure cloud-native solution development using Python, Java/Spring Boot, React, Azure AI services, storage, identity, monitoring, and CI/CD pipelines.
  • Lead architecture reviews, code reviews, technical decision-making, risk assessments, production readiness, observability strategies, and knowledge transfer activities.

 

Requirements:

  • Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, Data Science, or a related field.
  • 10+ years of experience in Software Engineering, Solution Architecture, Cloud Architecture, Data Engineering, AI Engineering, Integration, or Enterprise Delivery.
  • 3+ years of experience designing and delivering AI, Machine Learning, Generative AI, Intelligent Automation, or Advanced Analytics solutions.
  • Proven hands-on experience developing agentic AI solutions with tool-using agents, stateful orchestration, approvals, exception management, and recovery workflows.
  • Strong expertise in:
  • Large Language Models (LLMs)
  • Retrieval-Augmented Generation (RAG)
  • Prompt Engineering
  • Structured Outputs
  • Semantic & Vector Search
  • AI Evaluation Frameworks
  • AI Guardrails & Responsible AI
  • Experience architecting OCR/IDP, Conversational AI, Email Intelligence, Classification Engines, Recommendation Systems, and Workflow Automation solutions.
  • Strong knowledge of APIs, Microservices, Event-Driven Architecture, Security, Data Platforms, Observability, and DevOps.
  • Experience with Azure OpenAI, Azure AI Search, Azure AI Services, Azure Storage, Azure Identity, Azure Monitoring, Python, and cloud-native application development.
  • Proven ability to lead distributed engineering teams and collaborate effectively with business and technical stakeholders

 

 

 

 

 

 

 

In compliance with the salary transparency law, the expected pay range for this role is $50 – $70/hr. Actual compensation depends on experience and interview evaluation.

Similar jobs