Back to Jobs
Recently postedTechnology

AI Engineer - Malvern, PA

Innovative IT Solutions IncMalvern, PA🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeHybrid
LocationMalvern, PA, United States
AWSLLMPythonNode.jsJavaScriptTypeScriptPrompt EngineeringLangGraph

Job description

What you'll do

  • Build and debug LangGraph agent workflows.
  • Extend the eval harness and run A/B tests between agent and prompt variants.
  • Improve prompts with measured, regression-tested changes.
  • - Extend human-agent interactive UI.

Required

  • LangGraph experience: state graphs, checkpointing, interrupts, tool-calling agents.
  • LLM evals: golden sets, LLM-as-judge, A/B comparisons on quality, cost, and latency.
  • Robust prompt engineering, including structured outputs.
  • Python; Claude on AWS Bedrock a plus.

Nice to have

  • Front-end design (JavaScript/TypeScript; Tiptap or Y.js a plus).
  • LLM observability (Arize, OpenTelemetry).
  • Node.js and AWS.

Will your resume get past this employer's screening? Check your resume against this job, free

Similar jobs