AI Modeler (W2)

5+ years of software engineering experience with Python as your primary language • Hands-on experience with Amazon Bedrock - model invocation, Agents Knowledge Bases, and Guardrails • Experience with prompt engineering - designing, versioning, and evaluating prompts in a production context, not iust experimentation • Familiarity with LLM evaluation patterns: ground truth datasets, accuracy measurement, regression testing for model outputs Strong AWS fundamentals: Lambda, $3, SQS, SNS, EyentBridge, CloudWatch, IAM Secrets Manager • Experience with agentic patterns and tool use - building systems where the model calls external APIs as part of a reasoning chain • Comfortable working with structured and unstructured document formats (PDF Excel, DOCX) and document intelligence pipelines (AWS Textract or equivalent) • AWS ML certification is a plus; a demonstrated track record working with Bedrock and Foundation Models in production carries equal weight • Understanding of how to build observable Al systems - logging model inputs/outputs, tracking token costs, detecting accuracy drift in production