Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
Reading, PA, United States
Posted
22 hours ago
AWSMLOpsConfluenceLLMTerraform
Job Description
Must have skills: Agentcore, Terraform, AWS, Devops/SRE, Bedrock, IAM, MLOPS, Sagemaker.
Job Description
Observability:
- Assess CloudWatch, X-Ray, Bedrock logging, AgentCore traces vs. agentic workflow requirements; produce gap analysis, Setup observability in Dynatrace.
- Design post-deployment validation pipeline for agents & MCP servers (deployment health + tool registration checks).
- Implement distributed tracing & structured logging: LLM decisions, tool selections, sub-agent calls, MCP interactions.
- Evaluate LangFuse / LiteLLM proxy vs. AWS-native; deliver target-state observability architecture recommendation.
Cost Tracking & TCO:
- Extend tagging taxonomy to cover agent runtimes, MCP servers, vector DBs, Bedrock token consumption per namespace.
- Design cost visibility model: aggregate agent, MCP, vector DB, and Bedrock token costs per team/department.
- Build CloudWatch (or equivalent) dashboards for per-team spend; configure AWS Budgets with alerting thresholds.
- Automate cost reports delivered via email / Microsoft Teams; implement anomaly detection rules.
Monitoring & Alerting:
- Define P1–P4 alerting rules: deployment failures, runtime errors, tool invocation failures, MCP connectivity issues.
- Integrate alert notifications to Microsoft Teams channels and email; route by resource ownership tags.
- Author runbooks linked to every alert; publish in Confluence for developer self-service resolution.
- Evaluate AWS-native vs. third-party monitoring stack; deliver recommendation aligned to observability architecture.
Security & Access Control:
- Assess current IAM + tagging approach for multi-team isolation; identify scalability gaps and risks.
- Evaluate Cedar policy engine (AgentCore) for fine-grained tool access control; document enterprise-scale gaps.
- Design scalable ABAC-based identity model for multi-team isolation without IAM policy sprawl; deliver Terraform modules.
Department/Project Description:
Work with Client team to harden the new AWS AgentCore platform being setup so it can be used by teams to develop and deployAI agents.
Similar jobs
- US
Senior Cloud Platform Engineer – VMware VCF
NewUSG, Inc.
Dallas, TX🇺🇸On-site22 hours agoTCP/IPAnsibleDNS+5Technology - SP
Platform Engineer, Flight Software (Starlink)
SpaceX
Redmond, WA🇺🇸$125k - $145k/yrHybrid7 weeks agoEmbedded SystemsBashC+++1Technology - KT
Appian Platform Engineer II (Remote)
NewKforce Technology Staffing
Charlotte, NC🇺🇸Remote22 hours agoSQLAWSAgile+8Technology - KG
Hadoop Support with DevOps
NewK&K Global Talent Solutions
Charlotte, NC🇺🇸On-site22 hours agoOracleSQLSVN+11Technology - DI
SRE Azure Cloud
NewDigitive LLC
Pleasanton, CA🇺🇸On-site22 hours agoDockerMicroservicesMySQL+16Technology - MA
Infrastructure Engineer
NewMatchPoint
Downers Grove, IL🇺🇸$50 - $60/hrOn-site22 hours agoAWSActive DirectoryAzure+2Technology