Java AI Developer (Backend & AI/LLM)
Why This Role Stands Out
This hybrid role offers an exciting opportunity to blend your Java backend expertise with cutting-edge AI and LLM development, allowing you to architect and build innovative enterprise solutions. You'll thrive here if you're a mid-senior developer passionate about full-stack development, AI integration, and contributing to impactful projects within a reputable company. Don't miss the chance to apply and elevate your career in this dynamic field.
Quick Overview
Job Description
Job Title: Java AI Developer (Backend & AI/LLM)
Location: Irving, TX (Hybrid)
Duration: 12+ Months
Job Description:
We are seeking a Java Full Stack Developer with hands-on backend engineering depth and demonstrated experience integrating Large Language Model (LLM) capabilities into enterprise-grade applications. You will architect and build scalable microservices using Spring Boot, design agentic AI workflows using LangChain4j or Spring AI, and contribute across the full stack from React-based frontends to cloud-deployed backends. You will own end-to-end feature delivery for AI-powered modules, implement resilient LLM integration patterns, and drive technical best practices across the team.
Key Responsibilities:
- Design and develop scalable RESTful microservices and APIs using Java 17/21 and Spring Boot, following cloud-native and domain-driven design principles.
- Architect and implement LLM-powered features using LangChain4j or Spring AI including tool/function calling, agentic chains, RAG pipelines, and prompt engineering.
- Integrate LLM providers (OpenAI, Azure OpenAI, AWS Bedrock, or Anthropic Claude) into production systems with proper guardrails, hallucination mitigation, and evaluation frameworks.
- Build fault-tolerant service integrations using Feign clients and Resilience4j (circuit breakers, retries, rate limiters) to ensure system reliability against upstream failures.
- Implement asynchronous workflows using Kafka or similar messaging platforms; design job-ID-based async response patterns for long-running operations.
- Develop and maintain React-based front-end components, consuming REST APIs and handling loading, error, and success states cleanly.
- Manage conversation state and session context in MongoDB or equivalent NoSQL stores to enable multi-turn AI interactions and follow-up reasoning.
- Collaborate with product, QA, and platform teams in Agile sprints; contribute to design reviews, code reviews, and technical documentation.
Required qualifications:
- 8+ years of professional software development experience with Java; strong command of Java 17/21 features including virtual threads and modern concurrency patterns.
- Proven expertise with Spring Boot, Spring Security, Spring Data JPA, and microservices architecture; experience with API Gateway patterns and JWT-based authentication.
- Hands-on experience integrating LLMs via APIs (OpenAI, Azure OpenAI, AWS Bedrock, or Anthropic); practical knowledge of prompt engineering, RAG, embeddings, and vector databases.
- Experience with LangChain4j, Spring AI, or equivalent Java-native LLM frameworks for building agentic, tool-calling, or multi-step AI orchestration workflows.
- Proficiency in front-end development using React.js; ability to build, debug, and optimize component-based UIs and REST API integrations.
- Solid understanding of asynchronous messaging (Kafka, RabbitMQ), distributed systems patterns, and cloud deployment (AWS, Azure, or Google Cloud Platform)
- Ability to deploy and fine tune AI LLM models on devices like computers , routers etc. .Experience in Model API s.
Skills
Similar jobs
Principal AI Engineer, AI Security
Bluestaq · Colorado Springs, United States
1 hour ago$200k - $300k/yrSenior Lead AI Engineer, Gen AI Platform
Capital One · New York, United States
4 hours ago$229.9k - $262.4k/yrSenior Lead AI Engineer, Gen AI Platform
Capital One · Mc Lean, United States
4 hours ago$229.9k - $262.4k/yrAI Architect with Digital Products & Services
Reliable Software Resources · Dallas, United States
11 hours agoLead AI Developer- Agentic Systems Level 4 @ New York city New York 10175 (Hybrid)
Apptad Inc · New York, United States
11 hours ago€75/hrEnterprise AI Architect
VKore Solutions LLC · United States
11 hours ago