Quick overview
Job description
Position Summary
We are seeking an experienced AI Software Engineer to design, develop, deploy, and scale enterprise AI applications and intelligent agent solutions. The role combines software engineering, cloud-native development, and modern AI technologies to deliver secure, reliable, production-ready GenAI, RAG, and agentic AI solutions.
Key Responsibilities
- Develop AI applications using LLMs, GenAI, Retrieval-Augmented Generation (RAG), and agentic AI frameworks.
- Build REST APIs, microservices, and backend services using Python and FastAPI.
- Develop RAG solutions using enterprise data, embeddings, semantic search, and vector databases.
- Build autonomous and semi-autonomous agents using LangChain, LangGraph, OpenAI Agents SDK, and Google ADK.
- Implement agent capabilities including planning, routing, memory, state management, tool calling, and decision-making.
- Integrate agents with enterprise applications, APIs, databases, and business systems using Model Context Protocol (MCP) and Agent-to-Agent (A2A) communication.
- Implement prompt engineering, guardrails, evaluation frameworks, retries, fallbacks, and AI safety controls.
- Deploy and manage LLMs using Vertex AI, Gemini, vLLM, Ollama, Hugging Face, and open-source models.
- Containerize and deploy AI services using Docker, Kubernetes, and Helm.
- Optimize model serving for scalability, performance, availability, security, and cost.
- Implement monitoring, logging, tracing, and alerting using Prometheus, Grafana, and OpenTelemetry.
- Build CI/CD pipelines using GitHub Actions and automate testing, deployment, security scanning, and model releases.
Required Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, AI, or related field.
- 5+ years of software engineering experience, including 2+ years in AI, GenAI, or machine learning.
- Strong experience with Python, FastAPI, REST APIs, and microservices.
- Experience building production-grade GenAI, RAG, and agent-based applications.
- Strong knowledge of LLMs, embeddings, semantic search, vector databases, and RAG architectures.
- Experience with cloud-native development, Google Cloud Platform, Docker, Kubernetes, Helm, and CI/CD.
- Familiarity with vector databases such as Pinecone, Weaviate, Chroma, Milvus, or Vertex AI Vector Search.
Preferred Qualifications
- Experience with enterprise AI platforms, multi-agent architectures, and intelligent automation.
- Knowledge of Responsible AI, governance, security, compliance, MLOps, and LLMOps.
- Experience with model evaluation, benchmarking, and LLM observability.
- Experience integrating AI with enterprise applications such as ERP, CRM, ECM, HR, Legal, and Finance systems.
Similar jobs
- FA

Software Engineer Level 1 with Security ClearanceRecently posted
Fantom Corporation · Hanover, MD · On-site · Posted 17 Nov 2026 🇺🇸
DockerMATLABSQL+7TechnologySalary not listed - FA

Systems Engineer Level 0 with Security ClearanceRecently posted
Fantom Corporation · Fort Meade, MD · On-site · Posted 17 Nov 2026 🇺🇸
Computer VisionMachine LearningAgileTechnologySalary not listed - AW

Software Development Engineer, Bespoke Solutions; ADC Hardware & with Security ClearanceRecently posted
Amazon Web Services · Denver, CO · Hybrid · Posted 17 Nov 2026 🇺🇸
RustAWSEmbedded Systems+4Technology$110.5k - $160k/yr - FA

Software Engineer Level 2 with Security ClearanceRecently posted
Fantom Corporation · Hanover, MD · On-site · Posted 17 Nov 2026 🇺🇸
DockerComputer VisionC+++5TechnologySalary not listed - AM

Software Development Engineer , Cryptography and Identity Manage with Security ClearanceRecently posted
Amazon · Seattle, WA · Hybrid · Posted 17 Nov 2026 🇺🇸
AWSTechnology$168.1k - $227.4k/yr - FA

RF Software Engineer Level 2 with Security ClearanceRecently posted
Fantom Corporation · Hanover, MD · On-site · Posted 17 Nov 2026 🇺🇸
Computer VisionC++Python+3TechnologySalary not listed - FA

RF Software Engineer Level 2 with Security ClearanceRecently posted
Fantom Corporation · Fort Meade, MD · On-site · Posted 17 Nov 2026 🇺🇸
Computer VisionC++Python+3TechnologySalary not listed - WY
System Engineer 1 with Security ClearanceRecently posted
Wyetech · Annapolis Junction, MD · Hybrid · Posted 17 Nov 2026 🇺🇸
Technology$10k/yr - EG

Software Engineer/Junior Architect with Security ClearanceRecently posted
Eliassen Group · Aberdeen Proving Ground, MD · On-site · Posted 17 Nov 2026 🇺🇸
SQLGitC#+3TechnologySalary not listed - PE

Entry-level Software Engineer - TS/SCI w Poly with Security ClearanceRecently posted
Peraton · Fort Meade, MD · Hybrid · Posted 17 Nov 2026 🇺🇸
AgileTechnology$66k - $106k/yr - KT

Python Software EngineerRecently posted
Kforce Technology Staffing · New York, NY · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLApache SparkAWS+7TechnologySalary not listed - BA

Application Developer with Security ClearanceRecently posted
Booz Allen Hamilton · Laurel, MD · On-site · Posted 17 Nov 2026 🇺🇸
RustSQLHTML+11Technology$69.4k - $158k/yr
