Haystack
← Back to Jobs
Technology
ISInfodyne Solutions logo

Gen AI Architect

Infodyne SolutionsNew York, NY🇺🇸United StatesPosted Oct 15, 2026

Quick Overview

Seniority
Mid Senior
Work mode
On Site
Location
New York, NY, United States
Posted
20 hours ago
DockerFastAPIFlaskMicroservicesSQLAWSMLOpsAzureGPTGenerative AIGitHub ActionsGitLab CIGoogle CloudJenkinsKubernetesPythonRESTStakeholder ManagementTerraform

Job Description

Role: Gen AI Lead/Architect

Location: New York, NY

Duration: Long term

Note: Looking for local candidates.

Responsibilities:

  • Lead the architecture, design, and implementation of enterprise GenAI platforms and applications.
  • Design Agentic AI and multi-agent workflows using LangChain, LangGraph, CrewAI, AutoGen, Semantic Kernel, or Llama Index.
  • Build and optimize RAG pipelines, vector search solutions, embedding workflows, and enterprise knowledge systems.
  • Develop AI solutions for business process automation, knowledge management, intelligent document processing, conversational AI, decision support, and developer productivity.
  • Build scalable APIs and microservices using Python, FastAPI, or Flask.
  • Implement AI monitoring, observability, security, governance, guardrails, and responsible AI practices.
  • Optimize prompts, context management, model performance, latency, reliability, and cost.
  • Drive cloud deployment, CI/CD, DevOps, and MLOps practices.
  • Collaborate with stakeholders to identify AI opportunities and translate business needs into scalable solutions.
  • Mentor engineering teams and establish enterprise AI best practices.

Requirements:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, Artificial Intelligence, or a related field, or equivalent practical experience.
  • Strong expertise in Generative AI and LLMs, including OpenAI GPT, Claude, Gemini, Llama, or Mistral, with knowledge of prompt engineering, fine-tuning, function calling, tool integration, agent orchestration, context management, and memory handling.
  • Proficiency in Python and experience building REST APIs, microservices, and enterprise integrations using FastAPI or Flask.
  • Practical experience with RAG architecture, vector databases, embedding models, semantic and hybrid search, and document ingestion pipelines, using technologies such as Pinecone, Weaviate, ChromaDB, FAISS, Milvus, Elasticsearch, or OpenSearch.
  • Knowledge of Docker, Kubernetes, CI/CD, GitHub Actions, Jenkins, GitLab CI, Terraform, and cloud platforms such as AWS, Azure, or Google Cloud Platform. Familiarity with MLOps, model deployment, monitoring, logging, AI governance, security, SQL/NoSQL databases, and data pipelines. Strong communication, problem-solving, and stakeholder management skills.

Similar jobs