Databricks Engineer

Job Title: Databricks Engineer
Location: Cleveland, OH
Work Arrangement: Onsite – 4 days per week

Job Overview

We are looking for an experienced Databricks Engineer to design, develop, and optimize scalable data engineering solutions using Databricks and modern cloud data technologies.

Key Responsibilities

• Develop and maintain scalable data pipelines using Databricks, Apache Spark, and PySpark.
• Build and optimize ETL/ELT workflows for large-scale data processing.
• Develop data transformations using Python and SQL.
• Work with cloud data platforms, data lakes, and enterprise data warehouses.
• Implement data quality, performance optimization, monitoring, and troubleshooting.
• Collaborate with data architects, analysts, developers, and business stakeholders.
• Follow best practices for data security, governance, CI/CD, and deployment.
• Troubleshoot production issues and improve pipeline reliability and performance.

Required Skills

• Strong hands-on experience with Databricks and Apache Spark/PySpark.
• Strong Python and SQL development skills.
• Experience building enterprise-scale ETL/ELT data pipelines.
• Experience with cloud data platforms such as Azure, AWS, or Google Cloud Platform.
• Knowledge of Delta Lake and Databricks data engineering capabilities.
• Strong understanding of data modeling, data warehousing, and data lake architecture.
• Excellent troubleshooting and problem-solving skills.
• Databricks Certified Data Engineer Professional certification – MUST HAVE.
• Ability to work onsite in Cleveland, OH, 4 days per week.

Preferred

• Experience with Azure Data Factory / AWS Glue / similar orchestration tools.
• Experience with Git, CI/CD, and DevOps practices.
• Knowledge of Unity Catalog, Databricks Workflows, and Delta Live Tables.
• Experience working in Agile development environments.