Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
Lexington, MA, United States
Posted
3 days ago
DockerAWSETLCloudFormationDatabricksGenerative AILLMRedshiftTerraform
Job Description
Job Title: | Database Cloud Engineer |
Duration: | 18 Months |
Location: | San Francisco, CA |
Job Description:
We are seeking an experienced Lead Cloud Data Engineer to design and modernize enterprise-scale data platforms using AWS, Data Mesh architecture, and AI-driven solutions. This role will lead the development of scalable data pipelines, cloud infrastructure, and AI-enabled engineering practices while mentoring technical teams and supporting enterprise data modernization initiatives.
Job Responsibilities:
- Design, build, and maintain scalable ETL/ELT data pipelines using AWS services (Glue, EMR, Lambda, Kinesis, Step Functions).
- Develop and implement Data Mesh architecture with domain-driven data products and federated governance.
- Build modern cloud data platforms using Databricks, Delta Lake, Starburst/Trino, Collibra, and Immuta.
- Implement data governance, metadata management, data lineage, and automated data quality frameworks.
- Develop reusable frameworks and self-service tools for data publishing and consumption.
- Integrate DevSecOps practices including CI/CD pipelines, Infrastructure as Code (Terraform/CloudFormation), and security automation.
- Design AI-powered solutions, RAG pipelines, and agentic AI applications using Amazon Bedrock or similar LLM platforms.
- Provide technical leadership, mentor engineering teams, and support L3 production issues.
- Collaborate with business stakeholders to translate requirements into scalable cloud data solutions.
- Lead architecture reviews, technical documentation, and performance optimization initiatives.
Basic Qualifications:
- 7+ years of experience in Data Engineering, Cloud Data Platforms, or Data Architecture.
- Strong hands-on experience with AWS services including S3, Glue, EMR, Redshift, Lake Formation, Lambda, and Kinesis.
- Experience implementing Data Mesh architecture and modern data platforms using Databricks, Delta Lake, Starburst/Trino, Collibra, or Immuta.
- Proficiency in DevSecOps, CI/CD, Terraform/CloudFormation, Docker, and AI technologies such as Amazon Bedrock, RAG, or Generative AI.
Additional Information:
- Lead-level position requiring the ability to work independently with minimal supervision.
- Experience working in hybrid cloud and on-premises enterprise environments is highly preferred.
- Strong communication, leadership, and mentoring skills are essential.
- Candidates with experience supporting government or regulated AWS environments (GovCloud) are highly preferred.
Similar jobs
- TR
Cloud Engineer
NewTryfacta
United States🇺🇸RemoteYesterdayAWSMFAOAuth+11Technology - IT
Google Cloud Platform Cloud Engineer-W2 Only-Albany,NY-Onsite
NewISite Technologies Inc
Albany, NY🇺🇸On-siteYesterdaySQLLoad BalancingCDN+6Technology - AB
IT Cybersecurity Analyst - Cloud Security Engineer
NewAE Business Solutions
Milwaukee, WI🇺🇸$150k/yrOn-siteYesterdayEncryptionTechnology - VS
Cloud Resiliency Engineer
NewVigna Solutions Inc.
Texas City, TX🇺🇸HybridYesterdayScalaAWSOWASP+9 - BA
Senior Cloud Computing Application Architect
Booz Allen Hamilton
Chantilly, VA🇺🇸$86.8k - $198k/yrOn-site1 month agoMicroservicesOracleAWS+2Technology - MG
Cloud Engineer
NewMedinext Global LLC
Raleigh, NC🇺🇸On-siteYesterdayAWSAzureGoogle CloudTechnology