Data Engineer

Job Title: Data Engineer Databricks / Python / Scala/UDP

Work Location: Richardson, TX or Chicago, IL (Hybrid 2 or 3 Days Onsite)

Long Term Contract

If you find this opportunity suitable, kindly share your updated resume. Also, please let me know a good time to connect with you for a quick discussion.

Looking forward to hearing from you!

Job Description

We are seeking an experienced Data Engineer to join a data engineering team supporting a leading healthcare insurance client. The ideal candidate will have strong experience with Databricks, Python, Scala, SQL, and AWS and will be responsible for developing and supporting scalable data solutions.

Required Skills

• Strong hands-on experience with Databricks
• Strong programming experience in Python and/or Scala
• Advanced SQL skills
• Experience with AWS cloud services
• Experience with UDP
• Strong understanding of data engineering and ETL/ELT processes
• Experience working with large-scale data processing and distributed data environments
• Ability to develop, optimize, and troubleshoot data pipelines
• Experience working in Agile/Scrum environments

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks.
• Develop data processing solutions using Python and Scala.
• Write complex SQL queries for data transformation and analysis.
• Build and integrate data solutions using AWS services.
• Optimize data pipelines for performance, scalability, and reliability.
• Troubleshoot data processing and pipeline issues.
• Collaborate with data architects, developers, analysts, and business teams.
• Ensure data quality, security, and governance standards are followed.