Haystack
← Back to Jobs
Technology

Java AI Developer (Backend & AI/LLM)

InfoVision, Inc.Irving, TX🇺🇸United StatesPosted 20 Jul 2026

Why This Role Stands Out

This hybrid role offers an exciting opportunity to blend your Java backend expertise with cutting-edge AI and LLM development, allowing you to architect and build innovative enterprise solutions. You'll thrive here if you're a mid-senior developer passionate about full-stack development, AI integration, and contributing to impactful projects within a reputable company. Don't miss the chance to apply and elevate your career in this dynamic field.

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Job Title: Java AI Developer (Backend & AI/LLM)

Location: Irving, TX (Hybrid)

Duration: 12+ Months

Job Description:

We are seeking a Java Full Stack Developer with hands-on backend engineering depth and demonstrated experience integrating Large Language Model (LLM) capabilities into enterprise-grade applications. You will architect and build scalable microservices using Spring Boot, design agentic AI workflows using LangChain4j or Spring AI, and contribute across the full stack from React-based frontends to cloud-deployed backends. You will own end-to-end feature delivery for AI-powered modules, implement resilient LLM integration patterns, and drive technical best practices across the team.

Key Responsibilities:

  • Design and develop scalable RESTful microservices and APIs using Java 17/21 and Spring Boot, following cloud-native and domain-driven design principles.
  • Architect and implement LLM-powered features using LangChain4j or Spring AI including tool/function calling, agentic chains, RAG pipelines, and prompt engineering.
  • Integrate LLM providers (OpenAI, Azure OpenAI, AWS Bedrock, or Anthropic Claude) into production systems with proper guardrails, hallucination mitigation, and evaluation frameworks.
  • Build fault-tolerant service integrations using Feign clients and Resilience4j (circuit breakers, retries, rate limiters) to ensure system reliability against upstream failures.
  • Implement asynchronous workflows using Kafka or similar messaging platforms; design job-ID-based async response patterns for long-running operations.
  • Develop and maintain React-based front-end components, consuming REST APIs and handling loading, error, and success states cleanly.
  • Manage conversation state and session context in MongoDB or equivalent NoSQL stores to enable multi-turn AI interactions and follow-up reasoning.
  • Collaborate with product, QA, and platform teams in Agile sprints; contribute to design reviews, code reviews, and technical documentation.

Required qualifications:

  • 8+ years of professional software development experience with Java; strong command of Java 17/21 features including virtual threads and modern concurrency patterns.
  • Proven expertise with Spring Boot, Spring Security, Spring Data JPA, and microservices architecture; experience with API Gateway patterns and JWT-based authentication.
  • Hands-on experience integrating LLMs via APIs (OpenAI, Azure OpenAI, AWS Bedrock, or Anthropic); practical knowledge of prompt engineering, RAG, embeddings, and vector databases.
  • Experience with LangChain4j, Spring AI, or equivalent Java-native LLM frameworks for building agentic, tool-calling, or multi-step AI orchestration workflows.
  • Proficiency in front-end development using React.js; ability to build, debug, and optimize component-based UIs and REST API integrations.
  • Solid understanding of asynchronous messaging (Kafka, RabbitMQ), distributed systems patterns, and cloud deployment (AWS, Azure, or Google Cloud Platform)
  • Ability to deploy and fine tune AI LLM models on devices like computers , routers etc. .Experience in Model API s.

Skills

Microservices
MongoDB
Spring
Spring Boot
API Gateway
AWS
Agile
Azure
Google Cloud
JWT
Java
Kafka
LLM
REST
RabbitMQ
React

Similar jobs