Quick Overview
Seniority
Leader
Work mode
Hybrid
Location
New York, NY, United States
Posted
2 weeks ago
MicroservicesRustC++JavaLLMPython
Job Description
- 8–14 years of software engineering experience, with strong hands-on large-scale Python
- Working depth in at least one systems or backend language — Go, Rust, Java, or C/C++ — and the judgment to know when to reach for it
- Strong data structures and algorithms.
- Strong understanding of APIs, microservices, and system design
- Hands-on experience building and operating data pipelines and production-grade distributed systems.
Agentic AI and LLMs
- 2+ years of hands-on LLM engineering, with at least couple agentic system you designed and took to production
- Production experience with agent frameworks — LangGraph, Google ADK, CrewAI, Claude Agent SDK, or equivalent — and the fluency to move between them as the ecosystem evolves
- Experience building MCP (Model Context Protocol) servers and tool-calling interfaces
- RAG from first principles: chunking strategy, embeddings, vector and hybrid retrieval, reranking, and response validation
- Strong experience with vector databases (Milvus, Pinecone, Weaviate, FAISS, etc. or cloud equivalents)
- Design of guardrails and reliability patterns — validators, policy checks, self-correction loops, deterministic fallbacks, circuit breakers, and rollback paths
Optimization
- Deep familiarity with token optimization and context-window management — context shaping, pruning, and compaction
- Latency and cost optimization through caching, model routing, batching, streaming, and parallel tool calls
- Performance testing and tuning systems against defined SLOs
Similar jobs
- EI
AI Engineer III
NewElite IT Solutions inc
Houston, TX🇺🇸On-site21 hours agoTechnology - PT
AI Engineer
NewPeterson Technology Partners
Oak Brook, IL🇺🇸$70 - $75/hrOn-site21 hours agoSQLGitETL+6Technology - SS
Lead AI Engineer withAI agent logic
NewSIGNin Solutions Inc.
Chicago, IL🇺🇸On-site21 hours agoNeo4jPythonREST+4Technology - KI
AI Engineer (Maximum Rate: $40/hr)
NewKey Infotek LLC
United States🇺🇸$40/hrRemote21 hours agoGenerative AIHuman Resources - CG
AI Specialist
NewCCS Global Tech
Pontiac, MI🇺🇸Hybrid21 hours agoDockerGitGPT+4 - EN
917382 || Agentic AI Engineer (FDE)
NewExl Neo Technologies
United States🇺🇸On-site21 hours agoFastAPINestJSNext.js+15Technology - OR
ONA AI Agent Intern (Logistics Focus) - OVIP
NewOracle
Austin, Texas🇺🇸$19 - $36/hrHybrid1 hour agoOracleSQLCompliance+11 - VS
AI Engineer
NewVelocity Search Group Inc.
New York, NY🇺🇸Hybrid21 hours agoSQLGitHTML+10Technology - PM
AI Specialist
NewPMC
United States🇺🇸Hybrid21 hours agoDockerGitGPT+4 - VD
Gen AI Architect
NewVDart, Inc.
Cleveland, OH🇺🇸Hybrid21 hours agoMicroservicesMLOpsGDPR+11Technology - SS
Python Gen AI Developer
NewScadea Solutions Inc
Dallas, TX🇺🇸On-site21 hours agoDockerFastAPIFlask+15Technology - SS
AI Architect ; Production GenAI/LLM architecture (RAG, agents)
NewSKANDA SOLUTIONS LLC
Charlotte, NC🇺🇸Hybrid21 hours agoDockerMicroservicesAWS+14Technology