Quick overview
Job description
What you'll do
- Build and debug LangGraph agent workflows.
- Extend the eval harness and run A/B tests between agent and prompt variants.
- Improve prompts with measured, regression-tested changes.
- - Extend human-agent interactive UI.
Required
- LangGraph experience: state graphs, checkpointing, interrupts, tool-calling agents.
- LLM evals: golden sets, LLM-as-judge, A/B comparisons on quality, cost, and latency.
- Robust prompt engineering, including structured outputs.
- Python; Claude on AWS Bedrock a plus.
Nice to have
- Front-end design (JavaScript/TypeScript; Tiptap or Y.js a plus).
- LLM observability (Arize, OpenTelemetry).
- Node.js and AWS.
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- CS

Forward Deployed AI Solutions EngineerRecently posted
Cynet Systems · Ohio City, OH · Hybrid · Posted 19 Nov 2026 🇺🇸
Microsoft OfficeSOC 2Generative AI+2Technology$65 - $70/hr - CS

Senior Generative AI DeveloperRecently posted
Cynet Systems · Raleigh, NC · Hybrid · Posted 19 Nov 2026 🇺🇸
MicroservicesSQLEncryption+7Technology$75 - $80/hr - RE

AI/ML ArchitectRecently posted
Relanto, Inc. · San Jose, CA · Hybrid · Posted 19 Nov 2026 🇺🇸
DjangoDockerFastAPI+16TechnologySalary not listed - PR
Agentic AI ArchitectRecently posted
Prohires · Sunnyvale, CA · Hybrid · Posted 19 Nov 2026 🇺🇸
MicroservicesAWSGPT+9TechnologySalary not listed - PR
Ai ArchitectRecently posted
Prohires · Sunnyvale, CA · Hybrid · Posted 19 Nov 2026 🇺🇸
MicroservicesLLMGenerative AI+4TechnologySalary not listed - KS

Gen AI DeveloperRecently posted
Keypixel Software Solutions · United States · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerFastAPIOAuth+10TechnologySalary not listed - CT
AI Engineer (JNR LEVEL)Recently posted
CogniSoft Technologies · Washington, DC · On-site · Posted 19 Nov 2026 🇺🇸
DatabricksRAGTechnologySalary not listed - 3S

Senior Generative AI DeveloperRecently posted
3Core Systems, Inc · Raleigh, NC · On-site · Posted 19 Nov 2026 🇺🇸
SQLEncryptionLLM+3TechnologySalary not listed - IN
AI EngineerRecently posted
Infoyogi LLC · Austin, TX · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerFastAPISQL+26TechnologySalary not listed - IN
Gen AI DeveloperRecently posted
Innosoul inc · Raleigh, NC · Hybrid · Posted 19 Nov 2026 🇺🇸
SAFeDynamoDBFastAPI+20TechnologySalary not listed - HT

Senior Generative AI DeveloperRecently posted
HonorVet Technologies · Raleigh, NC · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerDynamoDBMicroservices+23TechnologySalary not listed - ST

Senior Generative AI DeveloperRecently posted
StoneGate-Technologies LLC · Raleigh, NC · On-site · Posted 19 Nov 2026 🇺🇸
SAFeDynamoDBFastAPI+19TechnologySalary not listed