Haystack
← Back to Jobs
Technology

Java with Agentic AI Engineer

Smart Info Solutions llcBethesda, MD🇺🇸United StatesPosted 28 Jul 2026

Quick Overview

Work Type
On Site
Level
Mid Senior

Job Description

 
 Java +AI/ Agentic AI Engineer
Location: Bethesda, MD (Onsite / Hybrid)
Experience Level: 12+ years
 
Role Type: Full-Time / Contract
 
 
About the Role
We are seeking a Lead Java + AI/Agentic AI Engineer with 8+ years of experience to design and build next-generation intelligent applications. The ideal candidate will have strong Java backend expertise combined with hands-on experience in AI Agents, LLMs, and agentic frameworks to deliver autonomous, decision-making enterprise solutions.
 
Key Responsibilities
- Java Engineering: Design, develop, and maintain scalable, high-performance microservices and APIs using Java 17+, Spring Boot, and Spring Cloud
- Agentic AI Development: Build and deploy AI Agents using LangChain, AutoGen, CrewAI, or similar frameworks. Implement tool-use, planning, memory, and multi-agent orchestration
- LLM Integration: Integrate OpenAI, Anthropic, Gemini, or open-source LLMs with enterprise applications. Work on RAG, prompt engineering, and function calling
- System Architecture: Architect event-driven, distributed systems with Kafka, REST, and cloud-native patterns on AWS/Azure/Google Cloud Platform
- Data & Vector DB: Work with vector databases like Pinecone, Weaviate, pgvector for semantic search and knowledge retrieval
- MLOps & DevOps: CI/CD pipelines, Docker, Kubernetes, and cloud deployment for AI services
- Leadership: Collaborate with Product, Data Science, and Business teams. Mentor junior engineers and drive best practices
- Security & Governance: Ensure secure, compliant, and responsible AI implementation
 
Required Skills & Qualifications
- 10+ years of overall software engineering experience
- 8+ years hands-on with Java, Spring Boot, Microservices, REST APIs
- 3+ years hands-on experience with Generative AI / LLM applications
- Strong experience with Agentic AI frameworks: LangChain, AutoGen, CrewAI, LlamaIndex
- Proficiency in Python for AI/ML integration along with Java
- Experience with Vector DBs, Embeddings, RAG pipelines
- Hands-on with Cloud platforms: AWS, Azure, or Google Cloud Platform
- Experience with Kafka, Docker, Kubernetes, CI/CD
- Strong understanding of System Design, Data Structures, and Algorithms
- Bachelor’s/Master’s degree in Computer Science or related field
 
 

Skills

Docker
Microservices
Spring
Spring Boot
AWS
MLOps
Azure
Generative AI
Google Cloud
Java
Kafka
Kubernetes
LLM
Python
REST

Similar jobs