Quick Overview
Job Description
We are seeking a highly technical Data Scientist with deep cloud experience, primarily AWS, to design, build, and operationalize machine learning and AI/LLM solutions. This role requires strong engineering discipline, current knowledge of generative and agentic AI, front-end delivery of model outputs, and a rigorous approach to governance, security, monitoring, and measurable model quality across the full model lifecycle.
Key Responsibilities:
Model Development & AI/ML Engineering
• Design, build, train, and validate machine learning models with strong understanding of data, feature engineering, and model behavior.
• Develop solutions using LLMs and generative AI, including OpenAI models/APIs.
• Design and implement agentic AI solutions, including multi-step, tool-using, autonomosemi-autonomous agents.
• Build and evaluate RAG solutions, including embeddings, vector search, semantic chunking, and retrieval strategies.
• Determine when to use AI/LLM solutions versus traditional deterministic or statistical approaches.
• Design human-in-the-loop (HITL) and human-on-the-loop (HOTL) workflows.
• Establish measurable testing and evaluation criteria such as accuracy, precision/recall, drift, latency, cost, hallucination rate, and bias metrics.
• Write and maintain automated test cases for model validation, including AI-assisted approaches for test coverage.
Operational Support & Model Lifecycle
• Provide operational support for deployed ML/AI models, including monitoring, incident triage, and troubleshooting.
• Implement governance and monitoring frameworks to track performance, drift, bias, and usage.
• Own model updates, including retraining, fine-tuning, versioning, and re-validation.
• Implement logging, tracing, audit trails, model decision tracking, and lineage.
Cloud, Engineering & Front-End
• Build and deploy solutions primarily on AWS, including SageMaker, Lambda, S3, ECS/EKS, and Bedrock.
• Strong coding skills in Python and Java.
• Build interactive front-end applications using React, TypeScript, or Java-based frameworks.
• Containerize workloads using Docker and manage GPU-based compute.
• Build and maintain CI/CD pipelines for ML/AI workloads.
• Apply DevSecOps principles, including security scanning, secrets management, infrastructure as code, and automated compliance checks.
Governance, Security & Responsible AI
• Ensure AI/ML solutions meet governance, legal, security, and regulatory requirements.
• Implement guardrails for data privacy, bias mitigation, content safety, access controls, and prompt-injection defenses.
• Ensure models and pipelines meet compliance requirements before production release.
Similar jobs
- IF
Data Scientist with Security Clearance
Integral Federal
Washington, DC🇺🇸Hybrid1 week agoAWSMachine LearningNLP+6Technology - TB
Data Scientist (NLP/Transformers) - FUNDED with Security Clearance
NewThe Britton Group
McLean, VA🇺🇸Hybrid2 days agoSQLMachine LearningNLP+4Technology - IB
Decision Scientist, Strategic Partner and Marketing Analytics
NewAuto ApplyIbotta
Hybrid - Denver🇺🇸Hybrid2 hours agoSQLETLLooker+7Marketing - SB
Data Scientist San Antonio - TX - Texas
NewSierra Business Solution LLC
San Antonio, TX🇺🇸Hybrid18 hours agoSQLMachine LearningSnowflake+2Technology - DA
Sr Data Scientist
NewAuto ApplyDataiku
United States🇺🇸$210k - $220k/yrHybrid8 hours agoSQLMLOpsMachine Learning+2Technology - VT
Data Scientist (REMOTE :: W2 ONLY)
NewVAAM Technologies
TX🇺🇸Remote18 hours agoSQLScalaLinear+10Technology - CF
Senior Data Scientist, Finance & Strategy
NewChime Financial, Inc
United States🇺🇸$133k/yrRemoteYesterdaySQLPythonREST+1Technology - GO
Data Scientist
NewGovcio LLC
Fort George G Meade, Maryland🇺🇸Hybrid4 hours agoGCPAWSETL+8Technology - AS
Data Scientist with Strong Statistics
NewAlchemy Software Solutions LLC
Atlanta, GA🇺🇸On-site18 hours agoTechnology - AS
DATA SCIENTIST-Level 4 - Lead (15+ Years)
NewApex Systems
Juno Beach, FL🇺🇸On-site18 hours agoPythonTechnology - CI
Senior Data Scientist Assistant Vice President - Citi
NewCiti
Tampa, FL🇺🇸$87.3k - $130.9k/yrHybrid18 hours agoSQLMachine LearningMicrosoft Excel+2Technology - RE
Mid Level Data Scientist
NewRedhorse Corporation
Washington, DC🇺🇸Hybrid18 hours agoSQLETLMachine Learning+2Technology