Architecting and Leadership:
o Deep understanding of modern data architecture, including Lakehouse, Medallion architecture, and Data Mesh.
Data Engineering:
o Strong programming experience in Python; Scala is a significant plus.
o Proficiency in complex query tuning.
o Experience building Slowly Changing Dimensions (SCD) TYPEs.
o Familiarity with DBT.
o Experience with structured streaming.
o Knowledge of data formats like Iceberg, Parquet, and Delta.
o Skills in Spark tuning and optimization.
o Git and CI/CD integration
Migration Experience:
o Demonstrated experience with large-scale migrations involving over 100 pipelines.
o Proficiency with various migration tools.
o Experience with other Enterprise Data Warehousing (EDW) platforms such as Snowflake and Redshift.
Familiarity with Databricks Technologies:
o Unity Catalog
o Delta Live Tables (DLT)
o Databricks SQL (DBSQL)
o Autoloader
o Photon engine
o Strong cultural fit within the Databricks ecosystem.
Cloud Technologies:
o Experience with Azure.
o Experience with AWS.
o Terraform is a plus.
Consulting Experience:
o Proven customer-facing experience.
Overall Strong Databricks skills and robust data engineering experience