Quick overview
Job description
We're looking for a GenAI Solution Architect who can do both: design the architecture of AI-powered systems and get hands-on building them. This isn't a slide-deck role or a pure advisory role. You'll be orchestrating and building agentic AI systems in real enterprise delivery environments - and helping clients understand what they've actually got.
At CompassX, we're delivering AI-enabled solutions for some of the most complex enterprise clients in financial services, pharma, and beyond. We need someone who has moved past the hype and is actively building with the tools - agents, orchestration frameworks, LLM integrations, and the data infrastructure that makes them work in production.
This role sits at the leading edge of our AI practice. You'll shape how we deliver GenAI engagements and help define what good looks like for our clients.
What You'll Do
-
Architect GenAI Solutions: Design end-to-end architectures for AI-powered applications - from LLM selection and prompt engineering through orchestration, retrieval-augmented generation (RAG), and integration with enterprise data environments.
-
Build and Orchestrate Agents: Go beyond design - build agentic AI workflows using frameworks like LangChain, LangGraph, AutoGen, CrewAI, or similar. You know how to orchestrate multi-agent systems and have shipped something real.
-
Own the AI Stack: Work across the full GenAI delivery stack: LLM APIs (OpenAI, Anthropic, Azure OpenAI, AWS Bedrock), vector databases, RAG pipelines, evaluation frameworks, and deployment infrastructure.
-
Bridge to Enterprise Systems: Integrate GenAI solutions with existing enterprise architecture - data platforms, APIs, identity and access controls, and compliance requirements. Make AI work within the constraints of real organizations.
-
Advise Client Leadership: Translate technical architecture decisions into clear strategic narratives for client leadership. Help clients move from AI experimentation to AI-enabled operations.
-
Accelerate the Team: Bring patterns, reusable components, and technical standards to the delivery team. Be the person who makes everyone else faster.
What You'll Bring
-
Hands-On GenAI Experience: You have built production or near-production GenAI systems - not just demos. You've wrestled with evaluation, hallucination, latency, and cost at the architecture level.
-
Agentic AI Fluency: Practical experience building agentic workflows and multi-agent systems using frameworks like LangChain, LangGraph, AutoGen, CrewAI, or similar. You understand where these tools shine and where they fall apart.
-
LLM Platform Breadth: Hands-on experience with major LLM platforms and APIs: OpenAI, Anthropic Claude, Azure OpenAI, AWS Bedrock, or equivalent. You know the trade-offs between them.
-
Engineering Foundation: Strong Python skills and comfort in cloud-native environments (AWS, Azure, or GCP). You can write the code, not just spec it.
-
Data Architecture Context: Understanding of how AI systems consume data - vector stores, embeddings, RAG architectures, and the data infrastructure that sits underneath production AI applications.
-
Consulting & Communication: Experience working in client-facing or consulting delivery contexts. You can navigate organizational complexity and explain AI architecture to both technical teams and senior business stakeholders.
-
Builder Mentality: You default to building. You use AI tools to accelerate your own work. You're excited to operate at the frontier of what's actually deployable in enterprise environments - not just what's theoretically possible.
Benefits
- Competitive salary with performance-based bonus
- PTO, holidays, and sabbatical program
- Health, dental, vision, and life insurance
- Retirement plan with company match from day one
- Learning and professional development support
- Small-firm culture with direct access to leadership
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- C1

Solutions Architect (Customer Success)Recently posted Auto Apply
C1 · Remote · Remote · Posted 13 Nov 2026 🇺🇸
AWSActive DirectoryCloudFormation+8TechnologySalary not listed - TT
Forward Deployed StrategistRecently posted Auto Apply
True Talent Solutions Partners · San Francisco or New York City · On-site · Posted 13 Nov 2026 🇺🇸
Enterprise Sales$160k - $250k/yr - HI

Oracle Cloud HCM Solutions Architect (1658)Recently posted Auto Apply
Highstreetit · United States · Hybrid · Posted 13 Nov 2026 🇺🇸
RecruitingStakeholder ManagementOracle+10TechnologySalary not listed - CA
Public Cloud Solution ArchitectRecently posted Auto Apply
Canonical_managed_posts · Charlotte Amalie · Hybrid · Posted 9 Nov 2026 🇺🇸
GCPAWSIoT+2TechnologySalary not listed - CA
Public Cloud Solution ArchitectRecently posted Auto Apply
Canonical_managed_posts · New York · Hybrid · Posted 9 Nov 2026 🇺🇸
GCPAWSIoT+2TechnologySalary not listed - TR
Solutions & Platform Architect - MicrosoftRecently posted Auto Apply
Trupanion · Seattle · Hybrid · Posted 12 Nov 2026 🇺🇸
Microsoft OfficeMFASSO+5Technology$145k - $165k/yr - DA
Principal Solutions ConsultantRecently posted Auto Apply
DataVisor · Mountain View, California · Remote · Posted 13 Nov 2026 🇺🇸
OnboardingComplianceCustomer Success+1Salary not listed - MO

Senior Solutions Architect (Pre-Sales)Recently posted Auto Apply
MongoDB · Detroit · Hybrid · Posted 13 Nov 2026 🇺🇸
MicroservicesMongoDBSQL+16TechnologySalary not listed - MI

Solutions Architect, ImplementationRecently posted Auto Apply
Microblink · US (EST Preferred) · Hybrid · Posted 13 Nov 2026 🇺🇸
OnboardingDockerSwift+14TechnologySalary not listed - KC
Solution SpecialistRecently posted Auto Apply
Kaseya Careers · Miami · Hybrid · Posted 13 Nov 2026 🇺🇸
Microsoft ExcelAccount ManagementCompliance+3Salary not listed - GL
Manager, Solutions Engineering | West Coast | RemoteRecently posted Auto Apply
Grafana Labs · United States (Remote) · Remote · Posted 13 Nov 2026 🇺🇸
OnboardingGitCustomer Success+4Engineering$234k - $278k/yr - GO

Senior Manager, Solution EngineeringRecently posted Auto Apply
Gong.io · Chicago | New York City · Hybrid · Posted 13 Nov 2026 🇺🇸
Stakeholder ManagementEngineering$255k - $300k/yr
