Haystack
← Back to Jobs
Technology

Agentic AI Engineer

ConglomerateITGeorgia, VT🇺🇸United StatesPosted 5 Jul 2026

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Title: Agentic AI Engineer
Location: US - Remote / Hybrid (multiple locations)
Type: Full-time or Contract (W2/C2C)
Level: Mid Senior

ConglomerateIT (CGIT) is building out its agentic AI bench to meet surging client demand. We're looking for engineers who have actually shipped AI agents to production - not just prototyped them - and can own the agent loop end to end.

What you'll do

  • Design and build agentic systems: planning loops, tool/function calling, agent memory, and multi-step reasoning

  • Build and tune RAG pipelines (chunking, embeddings, retrieval, re-ranking, grounding)

  • Integrate LLM APIs (OpenAI, Anthropic, Gemini) into reliable, production-grade workflows

  • Deploy agents to cloud, with evals, observability, guardrails, and cost/latency controls

  • Partner with client teams to take agents from PoC to production at scale

Must have

  • Strong Python

  • LangChain and/or LangGraph

  • RAG + a vector DB (Pinecone, Weaviate, pgvector, Qdrant, or similar)

  • Hands-on LLM API experience (OpenAI / Anthropic / Gemini)

  • One cloud (AWS, Azure, or Google Cloud Platform)

  • Demonstrated experience taking at least one agent/LLM system to production

Nice to have

  • MCP, LlamaIndex, CrewAI, AutoGen, or Semantic Kernel

  • LangSmith / LangFuse, FastAPI, Docker/Kubernetes, MLOps/CI-CD

Founded in 2014, is a global leader in delivering innovative IT solutions and services. Headquartered in the USA with a presence in the UK, Canada, and India, we specialize in offering industry-leading expertise and cutting-edge products that help our clients maximize their technological investments. Our focus on best-in-class solutions, a highly knowledgeable team, and proactive talent mapping ensure we remain at the forefront of the IT industry.

ConglomerateIT is driven by our Center for Excellence and Innovation, an initiative dedicated to keeping us ahead in a rapidly evolving technology landscape. We understand that building strong relationships is key to our success, and this commitment has enabled us to partner with Fortune 500 companies and leading system integrators worldwide. Our ability to provide local talent on a global scale ensures that we can meet the contingent project requirements of our clients efficiently and effectively.

Skills

Docker
FastAPI
AWS
MLOps
Azure
Google Cloud
Kubernetes
LLM
Python

Similar jobs