Senior Data Engineer / Application Data Developer Expert

Job Title: Senior Data Engineer / Application Data Developer Expert
Location: (Remote)

Responsibilities

• Serve as the primary technical owner for the enterprise Scala/Spark application framework.
• Develop, maintain, and enhance distributed data processing applications.
• Design, implement, and maintain Apache Spark batch processing workflows.
• Develop and manage Apache Hive data processing solutions and Hive tables.
• Maintain and enhance Drools business rules to support evolving business requirements.
• Support enterprise data ingestion processes for provider, member, reference, and source system data.
• Investigate and resolve production issues while ensuring system reliability and stability.
• Perform application performance tuning and optimize Spark processing jobs.
• Coordinate application deployments, version control, and production releases.
• Support Linux-based production environments and troubleshoot distributed Spark applications.
• Collaborate with infrastructure, cloud, and cross-functional teams to maintain platform availability.
• Develop and maintain technical documentation, operational procedures, and knowledge transfer materials.
• Follow Agile development methodologies and participate in code reviews and sprint activities.

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field (or equivalent experience).
• 7+ years of experience developing enterprise-scale distributed data processing applications.
• Strong hands-on programming experience with Scala.
• Extensive experience with Apache Spark (2.x/3.x).
• Experience working with Cloudera Data Platform (CDP) or enterprise Hadoop environments.
• Strong experience with Apache Hive.
• Experience implementing business rules using the Drools Rules Engine.
• Advanced SQL development and query optimization skills.
• Experience supporting Linux production environments.
• Experience troubleshooting distributed Spark applications.
• Experience using Git and modern version control practices.