Quick Overview
Seniority
Mid Senior
Work mode
Remote
Location
AK, United States
Posted
21 hours ago
DockerFastAPINeo4jRustETLSplunkConfluenceGitHub ActionsGoHelmKubernetesLLMPythonVault
Job Description
Role: Senior Python AI Engineer
Location: Remote (US)
Job Type: W2 Contract
Experience Required: 10+ years
JD:
-Knowledge Base Infrastructure
We are hiring a Python Platform Engineer to operate and evolve the infrastructure behind an enterprise knowledge base platform that is moving from a Confluence-focused RAG chatbot into a broader agentic knowledge system. Today, the platform supports Confluence/GitHub ingestion chunking pgvector RAG retrieval FastAPI serving. Over the next phase, we are expanding toward hybrid retrieval (vector + sparse + graph), multi-source ingestion, evaluation pipelines, agent infrastructure, harness and shared chat platform primitives.
What You'll Own:
- Architect and implement backend services in Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg
- Design retrieval and orchestration trade-offs around quality, latency, cost, safety, and operational simplicity
- Build production-grade agent runtime capabilities: memory boundaries, tool sandboxing, permissions, and budget controls
- Improve answer grounding, failure analysis, and citation enforcement rather than optimizing for demo behavior
- Create observability and operational feedback loops with OpenTelemetry, PrometheGrafana, Docker/Helm, and GitHub Actions
- Work closely with product and engineering partners to support multiple conversational surfaces through one knowledge platform
- Ingestion infrastructure across current and future content sources
- Observability across application, pipeline, database, and model-serving behavior
- Cost, latency, throughput, and failure-mode management for AI-heavy workloads
- Release workflows that validate AI behavior changes, not just code compilation
Qualifications:
- Strong hands-on experience with Python in platform, automation, or infrastructure-heavy environments
- Experience building CLI tools using Python, Golang or Rust.
- Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines
- Experience designing evaluation frameworks for LLM-backed systems, including regression detection and quality measurement
- Strong experience with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows
- Familiarity with the operational characteristics of embedding pipelines, vector search, and LLM-backed systems
- Strong observability skills across metrics, tracing, dashboards, alerting, and log analysis
- Experience with ingestion, ETL, or content-processing pipelines at scale
- Ability to think in terms of reliability, cost, latency, throughput, and recovery
Nice to Have:
- Experience with Qdrant, Neo4j, or other vector/graph infrastructure
- Experience supporting RAG, search, evaluation, or agent platforms
- Experience in enterprise or regulated environments
- Familiarity with Vault, Splunk, Artifactory, ECR
- Comfort using AI-assisted engineering workflows in day-to-day work
Similar jobs
- TE
Onsite || Gen AI Architect || Raritan NJ
NewTechridge, Inc.
Raritan, NJ🇺🇸Hybrid21 hours agoDockerMicroservicesSQL+13Technology - MW
Sr. AI Engineer with .NET strong developement background and Strong HealthCare Exp
Mind Ware Inc
Atlanta, GA🇺🇸$165k/yrHybrid4 days agoDockerMicroservicesMySQL+10Technology - UT
AI Architect
NewUp2date Technologies
Duluth, GA🇺🇸On-site21 hours agoSQLMLOpsMLflow+9Technology - AT
Generated AI Engineer
NewAcadia Technologies, Inc.
Delaware, OH🇺🇸Hybrid21 hours agoJavaPythonTechnology - AC
AI Architect & Governance
NewASoft Consulting LLC
Washington, DC🇺🇸Hybrid21 hours agoGenerative AIStakeholder ManagementTechnology - CG
AI Engineer / AI Builder public sector candidate only
NewCrowdplum Global Services LLC
Springfield, IL🇺🇸On-site21 hours agoDockerFastAPIAWS+7Technology