Haystack
← Back to Jobs
Technology
CO

GenAI Software Engineer (W2 only)

COOLSOFTAlpharetta, GA🇺🇸United StatesPosted Sep 17, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Alpharetta, GA, United States
Posted
19 hours ago
DjangoDockerFastAPIFlaskSQLGenerative AIJavaLLMPython

Job Description

Position Overview

We are seeking a top-tier Senior GenAI Software Engineer with 12+ years of software engineering and architecture experience and strong hands-on expertise in Generative AI, LLMs, AI Agents, Prompt Engineering, Context Engineering, and LangGraph.

The ideal candidate will have a proven track record of designing and building enterprise-grade production systems end-to-end, from architecture and development through deployment and continuous improvement. Candidates should have experience building AI-powered products and solutions from scratch, not just integrating existing AI APIs.

Must-Have Skills & Experience

  • 12+ years of experience in Software Engineering, Architecture, and Enterprise Application Development.
  • Strong experience designing and developing enterprise production solutions and systems end-to-end.
  • Extensive hands-on experience with Java and/or Python architecture and development.
  • Deep expertise in full-stack Python development, including:
    • FastAPI
    • Flask
    • Django
    • SQL and NoSQL databases
  • Strong hands-on experience with Generative AI and Large Language Models (LLMs), including OpenAI, Anthropic, and/or open-source LLMs.
  • Demonstrated expertise in Prompt Engineering and designing effective prompts for production LLM applications.
  • Strong understanding of Context Engineering, including:
    • Session management
    • Context management
    • Vector search
    • Knowledge retrieval
    • RAG strategies
    • Conversation memory
  • Proven experience designing and integrating AI Agents and LLM-powered capabilities into production systems.
  • Hands-on experience building AI agents and GenAI solutions from scratch.
  • Strong experience with conversational and agent orchestration frameworks, particularly LangGraph.
  • Experience designing conversational flows, agent workflows, tool calling, and multi-step reasoning workflows.
  • Strong knowledge of cloud infrastructure, Docker/containerization, CI/CD, and modern cloud-native development practices.
  • Experience taking GenAI applications from concept and architecture through development, deployment, and production.
  • Excellent analytical, problem-solving, communication, and collaboration skills.

Preferred / Plus

  • Contributions to open-source LLM, AI Agent, GenAI, or Prompt Engineering projects.
  • Experience with advanced RAG architectures and knowledge retrieval systems.
  • Experience building scalable enterprise AI platforms or AI-powered products.
  • Experience with multi-agent architectures and agentic workflows.
  • Experience optimizing LLM applications for performance, scalability, reliability, and cost.

Ideal Candidate Profile

We are specifically looking for top-tier candidates who can demonstrate:

  • Strong communication and stakeholder-facing skills.
  • A proven history of building complete enterprise products and solutions from scratch.
  • Deep hands-on experience with LLMs, Prompt Engineering, Context Engineering, RAG, AI Agents, and LangGraph.
  • Strong software architecture fundamentals combined with practical GenAI development experience.
  • Ability to independently take an idea from architecture development AI integration deployment production.
  • Candidates who have actually built and delivered GenAI/agentic systems, rather than candidates whose experience is limited to using AI tools or calling LLM APIs.Generative AI / GenAI

Similar jobs