Senior Data Engineer (Medicaid)- REMOTE

Primary Ownership

·         Own the Scala/Spark application framework supporting Medicaid Encounter Processing.

·         Own the Drools business rule implementation and ongoing rule maintenance.

·         Own enterprise data ingestion processes for master data and source system files.

·         Own Spark and Hive batch processing workflows.

·         Own production issue investigation and application defect resolution.

·         Own production releases, version management, and deployment coordination.

·         Own application performance tuning and optimization.

·         Own technical documentation, operational procedures, and knowledge transfer.

·         Provide basic operational administration and monitoring of the Cloudera Data Platform while coordinating with infrastructure and cloud operations teams.

Required Qualifications

·         Minimum 7 years of experience developing enterprise-scale distributed data processing applications.

·         Strong hands-on development experience with Scala.

·         Experience developing applications using Apache Spark 2.x and/or Spark 3.x.

·         Experience developing and maintaining applications running on Cloudera Data Platform (CDP) 7.x or equivalent enterprise Hadoop distributions.

·         Experience with Apache Hive 3.x for data processing and Hive table management.

·         Experience implementing business rules using the Drools Rules Engine.

·         Strong SQL development and query optimization skills.

·         Experience supporting Linux-based production environments.

·         Experience troubleshooting distributed Spark applications in production.

·         Experience using Git and modern version control practices.

Preferred Qualifications

·        Medicaid or healthcare experience.

·         Experience with Medicaid Encounter Processing.

·         Experience with Cloudera Manager, HDFS, and YARN.

·         Experience integrating with IBM DataStage.

·         Familiarity with AWS infrastructure supporting Cloudera.

·         Experience with Agile, Jira, and Confluence.