Why This Role Stands Out
Advance your career in cutting-edge agentic AI by shaping developer tools and SDKs, with opportunities for significant impact and professional growth in a hybrid environment. If you are a seasoned software engineer with a passion for LLM application development and building robust testing frameworks, this role offers a dynamic platform to excel. You'll thrive here, contributing to innovative solutions and expanding your expertise.
Quick Overview
Job Description
Role: Sr. Agentic AI Engineer (Agent SDK & Developer Enablement)
Location: Oaks, PA
Mode of Hire: Full Time
Skills Required:
• 3+ years hands-on experience in agent or LLM application development, having personally built and shipped applications using agent frameworks or SDKs such as LangChain, LangGraph, the OpenAI Agents SDK, Microsoft Agent Framework, or equivalent. This is non-negotiable for this position.
• 6+ years experience in professional software engineering, with production depth in at least two of C#, Python, Java and TypeScript or JavaScript, and the ability to work across all four. There is no one-language-per-engineer model on this team.
• 2+ years experience in building automated testing or evaluation for LLM or agent applications, using frameworks such as the Azure AI Evaluation SDK, Promptfoo, DeepEval, Ragas, LangSmith evaluation or equivalent. This includes handling non-deterministic output, building golden datasets, and running evaluation as a gate inside CI rather than as a manual exercise.
• 2+ years experience in working with agent memory and retrieval in application code: conversation and session state, short-term and long-term memory, and retrieval-augmented generation against a vector or search backend. You do not need to build the stores, but you must know what an agent developer needs from them and how these interfaces behave inside an agent loop.
• 3+ years experience in designing and maintaining libraries or SDKs consumed by other engineering teams: public API design, versioning, backward compatibility, and packaging to registries such as NuGet, PyPI, Maven or npm.
• 3+ years experience in building CI/CD pipelines using GitHub Actions, Azure DevOps or equivalent, including quality gates that block promotion.
• 2+ years experience in working with LLM application patterns in production: tool and function calling, structured output, streaming, context management, retries and fallback across providers, and prompt handling.
• Fluency with AI-assisted development tooling such as GitHub Copilot, Claude Code or Cursor, used daily as part of how you work. Team sizing on this engagement assumes that leverage.
• 2+ years experience in working with containerised deployment and a major cloud platform, sufficient to build scaffolds that deploy cleanly into Kubernetes and managed runtimes.
• Demonstrable developer experience judgement: building tooling, templates or libraries that other engineers adopted willingly, and iterating based on their feedback.
• Working knowledge of OpenTelemetry and how tracing is instrumented inside a client library.
Similar jobs
- KP
Chief Engineer, AI Developer Experience & Platform
NewKaiser Permanente
Greensboro, North Carolina🇺🇸Hybrid1 hour agoAgileTechnology - KP
Chief Engineer, AI Developer Experience & Platform
Kaiser Permanente
Greensboro, NC🇺🇸Hybrid7 weeks agoAgileTechnology - CO
Director- Applied AI
Covista
Lombard, IL🇺🇸$100.2k - $181.0k/yrHybrid3 days agoAWSScrumAzure+5Technology - AC
AI Developer
NewAPN Consulting Inc
Jersey City, NJ🇺🇸On-siteYesterdayMicroservicesAWSAgile+7Technology - JC
AI/ML SW Engineer L2 with Security Clearance
Jovian Concepts, LLC
Annapolis Junction, MD🇺🇸Hybrid4 days agoAWSAzureLLM+3Technology - EP
Sr Customer Experience AI Engineer
NewEpay Policy
Austin🇺🇸2 days ago401kSalesforceCustomer Retention+5Technology