Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
Johns Creek, GA, United States
Posted
Yesterday
SpringSpring BootAWSAzureDatadogGoogle CloudJavaLLM
Job Description
We are looking for a Backend AI Developer:
This role involves building an AI-powered tool designed for enterprise clients. It sits at the intersection of strong backend Java engineering and applied AI, focusing on designing and developing intelligent agents using Java and Spring-based technologies.
Responsibilities:
- Design, build, and deploy AI agents and agentic workflows using Java and Spring Boot.
- Develop production-quality APIs and backend services using Java 21 and Spring Boot 3.x.
- Implement agent capabilities including tool/function calling, memory and context management, planning, orchestration, retries, guardrails, validation, and multi-step workflows.
- Use Spring AI or LangChain4j to integrate LLMs and orchestrate agent workflows within Spring applications.
- Design effective LLM prompts using templates, roles, constraints, and structured outputs.
- Build and maintain LLM evaluations to measure agent quality, reliability, and performance.
- Implement LLM observability and monitoring, including tracing, latency, token usage, cost, and failure analysis.
- Apply RAG techniques, including chunking, embeddings, vector databases, and retrieval optimization.
- Use AI coding tools such as GitHub Copilot or Amazon Q as part of the daily software development workflow.
- Collaborate with engineers and stakeholders to prototype, test, and continuously improve AI capabilities.
- Write clean, maintainable, well-tested Java code while incorporating AI capabilities into production applications.
Requirements:
- Strong professional experience with Java, including modern Java versions such as Java 21.
- Strong experience with Spring Boot 3.x, including Spring Web, Spring Data, and Spring Security.
- Proven ability to build and support production APIs and backend services.
- Strong understanding of software engineering fundamentals, testing, debugging, and API design.
Required Skills:
- Hands-on experience building AI agents or agentic applications.
- Experience with Spring AI, LangChain4j, or a comparable agent/LLM orchestration framework.
- Understanding of agent architecture, including tool calling, memory, planning, orchestration, retries, and guardrails.
- Hands-on experience with LLM prompt design and prompt engineering.
- Experience designing or developing LLM evaluations.
- Understanding of RAG fundamentals, including embeddings, chunking, vector databases, and retrieval tuning.
- Experience with at least one LLM observability/monitoring platform, such as Langfuse, Arize, Weights & Biases, or Datadog.
- Daily hands-on experience using AI coding assistants, such as GitHub Copilot or Amazon Q.
- Comfortable incorporating AI into development, testing, debugging, refactoring, and code-generation workflows.
Preferred Skills:
- Experience optimizing LLM applications for performance and cost, including caching, batching, model routing, and prompt/token optimization.
- Experience evaluating and selecting AI models based on quality, latency, cost, and risk.
- Experience deploying AI services to AWS, Azure, or Google Cloud Platform.
- Experience with CLI-based coding assistants such as GitHub Copilot CLI or Claude Code.
- Experience with spec-to-code development, AI-generated testing, or automated refactoring.
- Experience with MCP (Model Context Protocol) or OpenAPI-based tool schemas.
- Experience integrating AI agents with enterprise APIs, databases, and external tools.
Similar jobs
- MS
Backend Developer with Security Clearance
NewMission Services LLC
Lorton, VA🇺🇸HybridYesterdayDockerMicroservicesScrum+3Technology - LT
Senior Specialist, Software Engineering (Back End Developer) with Security Clearance
NewL3Harris Technologies
Colorado Springs, CO🇺🇸$97k - $180k/yrHybridYesterdayDockerSQLSpring+3Technology - RE
🚀 Senior Java Backend Engineer ( U.S Citizen Only)
NewRecruitment.ai
San Jose, CA🇺🇸HybridYesterdayMicroservicesSpringSpring Boot+6Technology - DR
AWS Services Backend Engineer
Drevol LLC
Malvern, PA🇺🇸Hybrid1 week agoDynamoDBAWSGraphQL+1Technology - CS
Java Backend Developer
NewCynet Systems
Raleigh, NC🇺🇸HybridYesterdayMicroservicesSQLSpring+9Technology - RD
Java Back-end Developer
NewRandstad Digital
Charlotte, NC🇺🇸$54 - $65/hrHybridYesterdayOracleSQLSpring+9Technology