Databricks Data Engineer

We are seeking an experienced Databricks Data Engineer to design, develop, and optimize scalable data solutions using the Databricks platform. The ideal candidate will build and maintain enterprise data pipelines, support analytics and reporting solutions, and work closely with business teams to deliver reliable data-driven solutions.

Responsibilities:

• Develop and maintain Databricks-based data pipelines using Delta Lake, Delta Live Tables, and Workflows.
• Design and optimize ETL/ELT processes, data models, and data transformation workflows.
• Support Sales Incentive Compensation (SIC) processes, including commission calculations, quota management, and reporting.
• Collaborate with Finance, Sales Operations, and business teams to translate requirements into technical solutions.
• Troubleshoot data issues, improve pipeline performance, and ensure data quality.
• Integrate Databricks with cloud platforms such as Azure, AWS, or Google Cloud Platform and data services like Kafka or Azure Data Factory.
• Document data architectures, workflows, and technical processes.

Required Skills:

• 7+ years of experience in Data Engineering with 3+ years of Databricks experience.
• Strong experience with Databricks, Delta Lake, Unity Catalog, and Databricks Workflows.
• Proficiency in Python and/or Scala with advanced SQL skills.
• Experience with ETL/ELT, data modeling, and pipeline orchestration.
• Knowledge of Sales Incentive Compensation systems is a plus.
• Strong analytical, problem-solving, and communication skills.
• Databricks certification is preferred.