Quick overview
Job description
Job Title: Java- AI developer
Location: Englewood Cliffs, NJ- Onsite, no remote
Duration: Fulltime
Job Description:
Primary Stack: Java, Spring Boot, Microservices, GenAI, LLM, RAG, Vector Databases, Python, FastAPI
Must Have:
Java | Spring Boot | Microservices | GenAI | LLM | RAG | Vector Database | Python | FastAPI | REST APIs
Ideal Candidate Profile
The ideal candidate is fundamentally a strong Java/Spring Boot/Microservices engineer who has transitioned into hands-on GenAI engineering, rather than someone with only data-science or prompt-engineering experience.
Key Responsibilities
- Extensive experience (8+ years) with “Microservice Java” development and customization
- Design and develop scalable backend applications using Java, Spring Boot, and Microservices architecture.
- Design and implement GenAI applications leveraging LLMs.
- Build production-grade RAG pipelines for enterprise knowledge retrieval and question-answering use cases.
- Integrate LLM capabilities into existing Java/Spring Boot enterprise applications.
- Develop AI services and orchestration components using Python and FastAPI.
- Design REST APIs and microservices for communication between enterprise applications and AI services.
- Implement embedding, indexing, semantic search, retrieval, reranking, and response-generation workflows.
- Implement and optimize Vector Databases for semantic search and enterprise knowledge retrieval.
- Develop document ingestion, chunking, embedding, metadata management, and retrieval pipelines.
- Apply prompt engineering techniques to improve LLM response quality and reliability.
- Develop reusable components for LLM integration, RAG, prompt management, and AI service integration.
- Implement appropriate authentication, authorization, security, logging, exception handling, and observability across APIs and microservices.
- Containerize and deploy applications using Docker and CI/CD pipelines.
- Collaborate with architects, developers, data engineers, and business teams to translate requirements into production-ready GenAI solutions.
Mandatory Technical Skills
Java / Backend Engineering
- Strong hands-on experience with Java
- Strong expertise in Spring Boot
- Hands-on experience designing and developing Microservices
- RESTful API development
- Spring Security
- Spring Data / JPA
- API integration and backend system design
- Understanding of scalable and distributed application architecture
Generative AI / LLM
- Hands-on experience developing applications using Large Language Models (LLMs)
- Strong understanding of Generative AI application architecture
- Experience working with platforms/models such as:
- Azure OpenAI / OpenAI
- AWS Bedrock
- Llama
- Claude
- Gemini
- Strong understanding of Prompt Engineering
- LLM response evaluation and optimization
- Experience integrating LLMs with enterprise applications
Your previous GenAI JD similarly identifies OpenAI, Azure OpenAI, Claude, Gemini and Llama as relevant LLM experience.
RAG
- Strong hands-on experience designing and implementing Retrieval-Augmented Generation (RAG) solutions.
- Document ingestion and preprocessing
- Chunking strategies
- Embedding generation
- Semantic search
- Context retrieval
- Reranking
- Prompt/context construction
- RAG quality evaluation and optimization
Thanxs & Regards,
Harjeet Singh
Marlabs LLC. | One Corporate Place South | Piscataway, NJ 08854
Tel: X1496 | Cell: | Fax: |
US| Brazil | Canada| Germany | Bulgaria | India
Similar jobs
- CO

AI Engineer, Weapon Detection Auto Apply
Cover · San Jose · Hybrid 🇺🇸
Deep LearningPyTorchTensorFlow+1TechnologySalary not listed - CO

AI Engineer Auto Apply
CoreStory · Remote US · Remote 🇺🇸
DockerFastAPINeo4j+15TechnologySalary not listed - MI
AI & Automation Engineer Auto Apply
Minted · Remote · Hybrid 🇺🇸
LLMGenerative AITechnologySalary not listed - PO

Founding Engineer (Applied AI) Auto Apply
Polymr · polymr Office · On-site 🇺🇸
ProcurementServiceNowGenerative AIEngineeringSalary not listed - PA

AI Research Engineer Auto Apply
Pathos · San Francisco · Hybrid 🇺🇸
Clinical ResearchConcreteDiversity & Inclusion+3Salary not listed - OR
Staff Applied AI Engineer Auto Apply
Orum · San Francisco Bay Area · Hybrid 🇺🇸
NLPBigQueryContinuous Improvement+3TechnologySalary not listed - OU

Senior Applied AI Engineer Auto Apply
Outsmart · Lehi Office · On-site 🇺🇸
TechnologySalary not listed - CE

AI Engineer Auto Apply
CelLink Corporation · Georgetown · Hybrid 🇺🇸
WorkdaySQLMLOps+13TechnologySalary not listed - NU

Senior AI Engineer Auto Apply
Numosai · San Francisco Bay Area · On-site 🇺🇸
PyTorchPythonTensorFlow+1TechnologySalary not listed - KO
Founding AI Engineer Auto Apply
Kos.ai · San Francisco · Hybrid 🇺🇸
Computer VisionLLMGenerative AI+1TechnologySalary not listed - TG

AI Engineer I, II, III or SeniorRecently posted
Tri-State Generation and Transmission Association, Inc. · Westminster · Hybrid 🇺🇸
Stakeholder ManagementGCPAWS+16TechnologySalary not listed - GA

Senior AI Engineer - Machine Learning (US) Auto Apply
Gausslabs · Palo Alto · Hybrid 🇺🇸
TechnologySalary not listed
