Haystack
← Back to Jobs
Technology
SC

Database Cloud Engineer

SGS ConsultingLexington, MA🇺🇸United StatesPosted 29 Aug 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Lexington, MA, United States
Posted
3 days ago
DockerAWSETLCloudFormationDatabricksGenerative AILLMRedshiftTerraform

Job Description

Job Title:         

Database Cloud Engineer

Duration:        

18 Months

Location:    

San Francisco, CA

 

 

 

 

 

Job Description:

We are seeking an experienced Lead Cloud Data Engineer to design and modernize enterprise-scale data platforms using AWS, Data Mesh architecture, and AI-driven solutions. This role will lead the development of scalable data pipelines, cloud infrastructure, and AI-enabled engineering practices while mentoring technical teams and supporting enterprise data modernization initiatives.

 

Job Responsibilities:

  • Design, build, and maintain scalable ETL/ELT data pipelines using AWS services (Glue, EMR, Lambda, Kinesis, Step Functions).
  • Develop and implement Data Mesh architecture with domain-driven data products and federated governance.
  • Build modern cloud data platforms using Databricks, Delta Lake, Starburst/Trino, Collibra, and Immuta.
  • Implement data governance, metadata management, data lineage, and automated data quality frameworks.
  • Develop reusable frameworks and self-service tools for data publishing and consumption.
  • Integrate DevSecOps practices including CI/CD pipelines, Infrastructure as Code (Terraform/CloudFormation), and security automation.
  • Design AI-powered solutions, RAG pipelines, and agentic AI applications using Amazon Bedrock or similar LLM platforms.
  • Provide technical leadership, mentor engineering teams, and support L3 production issues.
  • Collaborate with business stakeholders to translate requirements into scalable cloud data solutions.
  • Lead architecture reviews, technical documentation, and performance optimization initiatives.

 

Basic Qualifications:

  • 7+ years of experience in Data Engineering, Cloud Data Platforms, or Data Architecture.
  • Strong hands-on experience with AWS services including S3, Glue, EMR, Redshift, Lake Formation, Lambda, and Kinesis.
  • Experience implementing Data Mesh architecture and modern data platforms using Databricks, Delta Lake, Starburst/Trino, Collibra, or Immuta.
  • Proficiency in DevSecOps, CI/CD, Terraform/CloudFormation, Docker, and AI technologies such as Amazon Bedrock, RAG, or Generative AI.

 

Additional Information:

  • Lead-level position requiring the ability to work independently with minimal supervision.
  • Experience working in hybrid cloud and on-premises enterprise environments is highly preferred.
  • Strong communication, leadership, and mentoring skills are essential.
  • Candidates with experience supporting government or regulated AWS environments (GovCloud) are highly preferred.

Similar jobs