Quick overview
Job description
Role: Senior AI Engineer (Agentic AI, Python & Risk Management)
Location: New York City, NY (Need local resource who can go for In-person)
Duration : 12+ Months
Additional Points: Strong Python and hands-on LangGraph experience, including context/prompt engineering, memory, evaluation, and observability using Galileo or similar tools. Risk management knowledge is highly desirable. Strong Python, SQL, and data engineering skills, with practical understanding of AI agents, context/prompt engineering, memory, evaluation, and observability.
About the role
We are seeking a hands-on Senior AI Engineer to design, develop, and operationalize agentic AI applications for Firm Risk Management. Potential use cases include cross-risk variance analysis, credit risk lifecycle workflows, continuous news monitoring, and model risk lifecycle processes. This is a software engineering role requiring strong Python design and development skills and practical experience building AI agents with LangGraph. The successful candidate will own technical design and implementation, with particular focus on context quality, agent memory, evaluation, observability, and reliable operation in a governed enterprise environment.
Key responsibilities
- Design and build modular, maintainable Python applications, APIs, and services that integrate LLMs, enterprise data, and business tools.
- Develop LangGraph-based agent workflows with explicit state, conditional routing, tool execution, checkpointing, and human-in-the-loop approval or escalation where appropriate.
- Engineer the context supplied to agents: select and assemble relevant instructions, retrieved information, tool outputs, and conversation history within token and access-control constraints.
- Design, version, and test prompts, including structured outputs, grounding instructions, and safe handling of incomplete or conflicting information.
- Implement appropriate short- and long-term memory strategies, including persistence, retrieval, summarization, retention, and isolation between users and sessions.
- Build evaluation frameworks with representative datasets, repeatable regression tests, and appropriate automated and human evaluation. Assess answer quality, grounding, tool-call correctness, task completion, and failure behavior.
- Implement LLM and agent observability using Galileo or comparable platforms, including execution traces, quality signals, latency, token usage, cost, and failure analysis.
- Apply guardrails for prompt injection, unsafe tool use, sensitive-data exposure, and unsupported outputs; incorporate access controls and auditable execution paths.
- Collaborate with risk specialists, product owners, data engineers, and platform teams to translate requirements into tested applications and support deployment and troubleshooting.
- Contribute technical design reviews, code reviews, documentation, and engineering guidance while remaining actively involved in coding.
Required skills and experience
- Strong hands-on Python software engineering, including application design, asynchronous programming, APIs, automated testing, error handling, and maintainable code.
- Demonstrated experience implementing AI agents with LangGraph, including stateful orchestration and integration with external tools or services—not only chatbots, framework tutorials, or conceptual designs.
- Practical understanding of LLMs, embeddings, retrieval-augmented generation (RAG), vector search, and the tradeoffs involved in retrieval and context assembly.
- Hands-on experience with context engineering, prompt engineering, and agent memory management.
- Experience designing and implementing evaluation frameworks for LLM or agent applications, including test-set construction and interpretation of evaluation results.
- Experience with Galileo or a comparable LLM/agent evaluation and observability platform, with the ability to trace failures and use findings to improve applications.
- Experience delivering and supporting deployed applications, with sound understanding of security, reliability, version control, CI/CD, and production troubleshooting.
- Ability to explain technical decisions, distinguish personal contributions from team outcomes, and collaborate effectively with business and engineering stakeholders.
Highly desirable
- Knowledge of Model Risk Management, model development/validation lifecycles, model documentation, governance, or model monitoring.
- Experience in broader risk management, particularly credit risk, market risk, or financial-services risk workflows.
- Experience with Snowflake, Databricks, lakehouse architectures, enterprise data pipelines, or governed knowledge integration.
- Familiarity with Model Context Protocol (MCP), cloud deployment, containers, and enterprise identity/access controls.
- Prior experience using AI coding assistants such as GitHub Copilot, Claude Code, or Amp, with disciplined review, testing, and secure handling of code and data.
Similar jobs
- BC

Forward Deployed AI Engineer, United States - BCG XRecently posted
Boston Consulting Group · Oakland, California · Hybrid · Posted 17 Nov 2026 🇺🇸
PythonData AnalysisTechnology$120k/yr - OT
Senior AI EngineerRecently posted
Oscar Technology · United States · Remote · Posted 17 Nov 2026 🇺🇸
AWSPythonTechnology$150k - $180k/yr - QT

Azure AI EngineerRecently posted
QUANTUM TECHNOLOGIES LLC · Dallas, TX · Hybrid · Posted 17 Nov 2026 🇺🇸
DockerGitMLOps+11Technology$73/hr - HG

AI EngineerRecently posted
HTC Global Services · Madison, WI · Hybrid · Posted 16 Nov 2026 🇺🇸
NumPyScikit-learnLLM+8TechnologySalary not listed - TM

Python AI EngineerRecently posted
Tech Mahindra (Americas) Inc. · Cleveland, OH · On-site · Posted 16 Nov 2026 🇺🇸
MLOpsNLPLLM+8TechnologySalary not listed - ME
AWS AI ArchitectRecently posted
Merican Inc · Seattle, WA · On-site · Posted 16 Nov 2026 🇺🇸
ShellAWSSSO+4TechnologySalary not listed - TT
Founding AI EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 17 Nov 2026 🇺🇸
Next.jsPlaywrightNode.js+1Technology$216k - $250k/yr - AE

Senior Agentic AI Engineer - Core PlatformsRecently posted Auto Apply
American Express · New York · Hybrid · Posted 17 Nov 2026 🇺🇸
C++GPTHadoop+9TechnologySalary not listed - AE

Senior Agentic AI Infrastructure Engineer I - Core PlatformsRecently posted Auto Apply
American Express · New York · Hybrid · Posted 17 Nov 2026 🇺🇸
DockerShellGit+21TechnologySalary not listed - BG
AI Application Intern (8 months/40 hours per week)Recently posted Auto Apply
Bosch Group · Farmington Hills, MI · On-site · Posted 17 Nov 2026 🇺🇸
Microsoft OfficeGenerative AIData Analysis+1EngineeringSalary not listed - QP
AI, Data & Automation EngineerRecently posted Auto Apply
Qualderm Partners · Brentwood, Tennessee · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLGitETL+12TechnologySalary not listed - OP

Applied AI Architect - EDURecently posted Auto Apply
Openai · San Francisco · Hybrid · Posted 17 Nov 2026 🇺🇸
LLMPythonGenerative AI+1TechnologySalary not listed