Haystack
← Back to Jobs
Technology
PH

Application Senior GenAI Architect

Purple HiresNew York, NY🇺🇸United StatesPosted 25 Aug 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
New York, NY, United States
Posted
20 hours ago
MicroservicesSQLGenerative AILLMPythonStakeholder Management

Job Description

Application Senior GenAI Architect

Location: NYC / NJC – Hybrid
FTE

 Job Description

We are looking for a Senior GenAI Architect with strong expertise in Data Engineering, Analytics, Generative AI, and Agentic AI workflows. The candidate will design and build scalable AI-driven solutions that leverage enterprise data, LLMs, RAG, and agent-based architectures.

Key Responsibilities:

  • Design and develop GenAI and Agentic AI applications using Python and modern AI frameworks.
  • Build scalable data pipelines, data processing, and analytics solutions.
  • Develop LLM/RAG-based applications integrating enterprise data sources.
  • Design and implement agentic workflows, AI agents, orchestration, and tool integrations.
  • Work with structured and unstructured data to support AI and analytics use cases.
  • Integrate LLMs with APIs, databases, knowledge sources, and enterprise platforms.
  • Implement evaluation, monitoring, security, and governance for GenAI solutions.
  • Collaborate with Data Engineers, Data Scientists, Architects, and business stakeholders.
  • Drive solutions from POC/prototype through production deployment.

Must-Have Skills

  • 15+ years of software/data engineering experience
  • Strong Python
  • Generative AI / LLM / RAG
  • Agentic AI / AI Agents / Agent Orchestration
  • Strong Data Engineering & Analytics
  • SQL and modern data platforms
  • Experience with APIs, microservices, and cloud platforms
  • Experience with LLM frameworks such as LangChain, LangGraph, or similar
  • Strong understanding of AI architecture, data architecture, and enterprise integration
  • Excellent communication and stakeholder management skills

Similar jobs