Haystack
← Back to Jobs
Remote
Technology
BT

Senior AWS Data Engineer

Brillfy TechnologyUnited States🇺🇸United StatesPosted Oct 12, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Remote
Location
United States
Posted
Yesterday
DockerSQLAWSETLApacheApache SparkCloudFormationDatabricksGitKubernetesPythonRedshiftTerraform

Job Description

Hiring: Senior AWS Data Engineer

Client: Guidehouse
End Client: CMS (Centers for Medicare & Medicaid Services)
Location: 100% Remote

Experience :-12+ years
Share your resumes to

Job Description

Guidehouse is seeking an experienced Senior AWS Data Engineer to support a large-scale CMS healthcare data and analytics platform. The ideal candidate will have strong hands-on experience with AWS data services, ETL/ELT pipelines, cloud data lakes, and large-scale data processing using Python, SQL, and PySpark.

Key Responsibilities

  • Design, develop, and maintain scalable AWS data pipelines and ETL/ELT processes.

  • Build data ingestion and transformation workflows using AWS Glue, PySpark, Python, and SQL.

  • Develop and optimize cloud data lakes and warehouses using Amazon S3, Athena, and Redshift.

  • Design data models for analytics, reporting, and operational requirements.

  • Integrate structured and unstructured data from multiple sources.

  • Support dashboards and reporting solutions using Amazon QuickSight.

  • Implement automated testing, monitoring, and performance optimization.

  • Follow security, data governance, and compliance requirements for CMS and federal environments.

  • Support CI/CD and Infrastructure as Code using Terraform, CloudFormation, and Git.

  • Troubleshoot data quality, pipeline performance, and production issues.

Required Qualifications

  • 7+ years of experience in data engineering, cloud engineering, or related roles.

  • 5+ years of hands-on AWS experience in production environments.

  • Strong proficiency in Python, SQL, and PySpark.

  • Hands-on experience with AWS Glue, Amazon S3, Amazon Athena, and Amazon Redshift.

  • Strong experience building enterprise ETL/ELT pipelines.

  • Knowledge of cloud-native data architectures, data warehousing, and dimensional modeling.

  • Experience with Terraform and/or CloudFormation.

  • Experience with Git, CI/CD pipelines, and DevOps practices.

  • Familiarity with Docker and Kubernetes.

  • Excellent analytical, troubleshooting, and communication skills.

Preferred Qualifications

  • Experience supporting CMS or other federal healthcare agencies.

  • Knowledge of Medicare, Medicaid, healthcare claims, or beneficiary datasets.

  • Experience with AWS GovCloud.

  • Experience with Amazon QuickSight, including dashboards, datasets, SPICE, and Direct Query.

  • Experience with Databricks or Apache Spark.

  • Knowledge of IAM, KMS, Secrets Manager, and cloud security.

  • AWS certifications such as AWS Certified Data Engineer or Solutions Architect.

Nice to Have

  • Medicaid Enterprise Systems experience.

  • Healthcare interoperability initiatives.

  • Data governance and Master Data Management (MDM).

Interested candidates: Please share your updated resume highlighting relevant AWS data engineering experience.

Similar jobs