Haystack
← Back to Jobs
Technology

Senior AI Solution Architect

Alpha SiliconRaritan, NJ🇺🇸United StatesPosted 9 Jul 2026

Quick Overview

Work Type
On Site
Level
Mid Senior

Job Description

Job Title: Senior Solution Architect-Gen AI

Location: Raritan, NJ (Onsite)
Duration: Long Term Contract/Full Time

Job Description:

We are seeking a highly skilled Senior Solution Architect Generative AI (Gen AI) to lead the design and delivery of next-generation AI-driven solutions for our enterprise clients. This role combines deep technical expertise in AI/ML with strong solution architecture skills and business acumen. The ideal candidate will be responsible for defining scalable Gen AI architectures, guiding implementation teams, and ensuring alignment with client business objectives while driving innovation and adoption of Gen AI technologies.

Key Responsibilities

Solution Architecture & Design

  • Lead the architecture and design of end-to-end Gen AI solutions, including LLM integration, Retrieval Augmented Generation (RAG), fine-tuning, and prompt engineering.

  • Define scalable architectures across cloud platforms (Azure, AWS, Google Cloud Platform) for model deployment, training pipelines, and inference workloads.

  • Design secure and compliant architectures that address data privacy, governance, and ethical AI considerations.

Technical Leadership

  • Provide technical guidance to engineering and data science teams on implementing Gen AI use cases across industries (chatbots, knowledge assistants, document processing, code generation, etc.).

  • Develop and enforce best practices for Gen AI architectures, including performance optimization, scalability, and monitoring.

  • Conduct technical reviews, proof-of-concepts, and solution validation with stakeholders.

Stakeholder Engagement & Consulting

  • Partner with business and product leaders to identify and prioritize AI/ML opportunities that align with strategic objectives.

  • Translate business problems into technical solutions using Gen AI frameworks and methodologies.

  • Present solution options, architecture diagrams, and roadmaps to executive stakeholders.

Innovation & Thought Leadership

  • Stay ahead of industry trends in Generative AI, LLMs, multimodal AI, LangChain, LangGraph, and vector databases.

  • Drive innovation by recommending new tools, frameworks, and approaches to maximize the value of AI investments.

  • Mentor teams and contribute to building organizational Gen AI capabilities.

Qualifications & Skills
  • Bachelor s or Master s degree in Computer Science, AI/ML, Data Science, or related field.

  • 12+ years of IT/solution architecture experience, with at least 3 5 years in AI/ML and Gen AI solutions.

  • Strong expertise in LLMs (OpenAI, Anthropic, LLaMA, Falcon, Mistral, etc.), RAG, embeddings, fine-tuning, and prompt engineering.

  • Hands-on experience with LangChain, LangGraph, Pinecone, Weaviate, FAISS, or Milvus.

  • Proficiency in Python and AI/ML libraries (PyTorch, TensorFlow, Hugging Face, Scikit-learn).

  • Cloud expertise in Azure OpenAI, AWS Bedrock, Google Cloud Platform Vertex AI.

  • Experience with MLOps tools (MLflow, Kubeflow, Databricks, Azure ML).

  • Strong knowledge of data engineering pipelines, vector databases, and API integrations.

  • Familiarity with AI governance, ethics, and responsible AI frameworks.

  • Excellent communication, client-facing, and stakeholder management skills.

  • Preferred certifications: Azure/AWS/Google Cloud Platform AI/ML Architect, TOGAF, or equivalent.

Skills

AWS
MLOps
MLflow
Scikit-learn
Azure
Databricks
Generative AI
Google Cloud
Hugging Face
LLM
PyTorch
Python
Stakeholder Management
TensorFlow

Similar jobs