Back to Jobs
Recently postedOther

Senior Data Engineers

Solvency IncUnited States🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeOn Site
LocationUnited States
DockerSQLShellApache SparkAWSAirflowBashComplianceData PipelineEHREMRElectronic Health RecordsGoogle CloudPythonRedshiftAzureKubernetes

Job description

Senior Data Engineers

Join our dynamic team as a Senior Data Engineer with 10+years of experience , where you will play a pivotal role in designing, building, and maintaining our data infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure the seamless flow of data across our systems. Your expertise will help us to drive data-driven decision-making and support our mission to improve healthcare outcomes.

Responsibilities

  • Design, develop, and maintain robust data pipelines to ensure the efficient and reliable flow of data.
  • Collaborate with cross-functional teams to understand data requirements and translate them into scalable data solutions.
  • Implement data ingestion processes from various sources, including Electronic Health Records (EHR) systems, ensuring data quality and integrity.
  • Optimize existing data pipelines for performance, scalability, and cost-efficiency.
  • Develop and manage data workflows using tools like Airflow, ensuring timely and accurate data processing.
  • Leverage AWS services such as S3, Redshift, Lambda, EMR, and Glue to build and manage data infrastructure.
  • Write and maintain Python, PySpark, SQL, and BASH/Shell scripts to automate data processing tasks.
  • Ensure data security and compliance with industry standards and regulations.
  • Mentor and guide junior data engineers, fostering a culture of continuous learning and improvement.

Requirements

<>Required Skills

  • Healthcare Insurance domain experience (Mandatory)
  • Strong experience in Data Engineering & Data Architecture
  • Proficiency in AWS services: S3, Redshift, Lambda, EMR, Glue
  • Strong programming skills in Python, PySpark, SQL, and BASH/Shell scripting
  • Experience with Airflow for managing data workflows and Big Data Processing
  • Expertise in Data Pipeline Development & Optimization

<>Preferred Skills

  • Experience with Electronic Health Record (EHR) systems
  • Familiarity with other cloud platforms (e.g., Azure, Google Cloud Platform)
  • Knowledge of data governance and data quality frameworks
  • Experience with containerization technologies (e.g., Docker, Kubernetes)
  • Strong problem-solving skills and attention to detail

⚠️ Candidates must be available for an in-person interview in Michigan.

Similar jobs