Senior Data Engineer

Job Description:
What are they looking for: 
Dev Engineer capabilities (this is the core of the role)
App dev experience (scripting, especially in python)
Expert in AI or Automation (this would be a huge plus)
NOTE: they understand this might be a unicorn, so these are listed in priority with 2 and 3 being bonuses 
Proficient in data manipulation and pipeline development
· Experience processing large datasets in a distributed environment
·Hands-on experience with Databricks notebooks, workflows, and cluster management
·     Moderate hands-on experience with S3, Lambda, Glue, and EC2
·     Experience scheduling and automating pipelines
·     Strong SQL skills for complex data extraction and transformation queries
·     Comfortable with version control in a collaborative, shared-repo environment
·     Comfortable creating and managing issues and epics
Summary
·     Modernize data pipeline from SAS to Python/PySpark on Databricks.
o   This Data Engineer will own and evolve our critical HEDIS data pipeline.
§  HEDIS data is delivered to our analytics vendor and used to measure BCBS’s performance across key dimensions of care.
o   This role will initially partner with SMEs during a knowledge transfer period.   They will eventually take on pipeline ownership.