Quick Overview
Job Description
Build agentic AI systems: Design and implement tool-calling agents that combine retrieval, structured reasoning, and secure action execution (function calling, change orchestration, policy enforcement). Engineer robust guardrails for safety, compliance, and least-privilege access.
Productionize LLMs: Build evaluation framework for open-source and foundational LLMs; implement retrieval pipelines, prompt synthesis, response validation, and self- correction loops tailored to production operations.
Integrate with runtime ecosystems: Connect agents to observability, incident management, and deployment systems to enable automated diagnostics, runbook execution, remediation, and post-incident summarization with full traceability.
Safety, reliability, and governance: Build validator models, adversarial prompts, and policy checks into the stack; enforce deterministic fallbacks, circuit breakers, and rollback strategies; instrument continuous evaluations for usefulness, correctness, and risk.
Scale and performance: Optimize cost and latency via prompt engineering, context management, caching, model routing, and distillation; leverage batching, streaming, and parallel tool-calls to meet stringent SLOs under real-world load.
Build a RAG pipeline: Curate domain-knowledge; build data-quality validation framework; establish feedback loops and milestone framework maintain knowledge freshness.
Raise the bar: Drive design reviews, experiment rigor, and high-quality engineering practices; mentor peers on agent architectures, evaluation methodologies, and saf deployment patterns
ESSENTIAL SKILLS
1. 5+ years of software development in one or more languages strong hands-on
experience building and maintaining large-scale Python applications preferred.
2. Practical experience with Large Language Models (LLMs): API integration, prompt
engineering, fine-tuning/adaptation, and building applications using RAG and tool-
using agents (vector retrieval, function calling, secure tool execution).
3. Understanding of different LLMs, both commercial and open source, and their
capabilities (e.g., OpenAI, Gemini, Llama, Qwen, Claude).
4. Solid grasp of applied statistics, core ML concepts, algorithms, and data structures to
deliver efficient and reliable solutions.
5. Strong analytical problem-solving, ownership, and urgency; ability to communicate
complex ideas simply and collaborate effectively across global teams with a focus on
measurable business impact.
Similar jobs
- BH
AI Engineer
NewBeacon Hill
Indianapolis, IN🇺🇸Hybrid19 hours agoDockerFastAPINode.js+16Technology - SR
Senior AI Solutions Engineer
NewSECURE RPO LLC
United States🇺🇸Remote19 hours agoLLMTechnology - NG
Gen AI lead / Gen AI Architect
NewNexylum Global LLC
New York, NY🇺🇸Hybrid19 hours agoMLOpsMachine LearningAzure+2Technology - DT
AI Engineer
NewDonato Technologies Inc
Dallas, TX🇺🇸Hybrid19 hours agoC++JavaPythonTechnology - IS
Gen AI Architect
NewInfodyne Solutions
New York, NY🇺🇸On-site19 hours agoDockerFastAPIFlask+16Technology - YS
Agentic AI Engineer
NewYotta Systems INC
New York, NY🇺🇸Hybrid19 hours agoAWSAzureGoogle Cloud+1Technology - VE
Gen AI Engineer
NewVentechsoft Inc
Dallas, TX🇺🇸Hybrid19 hours agoDockerFastAPIFlask+12Technology - ZT
AI Engineer
NewZuven Technologies Inc
United States🇺🇸Remote19 hours agoDockerMLOpsMachine Learning+15Technology - PR
15+ AI Architect at Plano TX
NewProhires
Plano, TX🇺🇸On-site19 hours agoDockerSQLScala+14Technology - DE
AI Engineer / Application Developer
NewDTEL Engineering & Consultants Inc
Woonsocket, RI🇺🇸Hybrid19 hours agoMicroservicesNode.jsPython+2Technology - AG
Agentic AI Engineer
NewAIT Global, Inc.
New York, NY🇺🇸Hybrid19 hours agoAWSAzureGoogle Cloud+1Technology - PS
Staff AI Product Engineer, FW/SW
NewAuto ApplyPsiQuantum
Milpitas🇺🇸Hybrid3 hours agoFiberEmbedded SystemsC+++3