Back to Jobs
Engineering

Technical Lead - Databricks Engineer

USEReadyMississauga, ON🇺🇸United States

Why this role stands out

As a Technical Lead Databricks Engineer at USEReady, you'll architect and optimize scalable data solutions using cutting-edge Azure technologies, offering significant opportunities for technical leadership and professional development. This hybrid role in Mississauga is ideal for a seasoned engineer with deep Databricks and Python expertise who thrives on building robust, efficient data platforms. Apply now to shape the future of data engineering with a reputable company.

Quick overview

SeniorityMid Senior
Work modeHybrid
LocationMississauga, ON, United States
Unity

Job description

Job Location: Mississauga, ON, Canada

Job Title: Technical Lead - Databricks Engineer

Duration: 12 Months / Fulltime

Target Start Date: ASAP

About the Role

We re looking for a Technical Lead Azure Data Engineer with deep expertise in Databricks and modern Azure data engineering tools. You ll design, build, and optimize scalable data pipelines and solutions, leveraging advanced features of Databricks and Azure to deliver high-quality, secure, and efficient data platforms.

Key Skills & Expertise

  • Strong hands-on experience with Databricks, including:
    • Databricks Notebooks (Python, SQL)
    • Unity Catalog for governance & security
    • Advanced Databricks performance optimization techniques
    • Best practices for cost and compute efficiency
  • Proficient in Azure Data Factory (ADF) for orchestrating ETL workflows.
  • Excellent programming in Python, with advanced PySpark skills.
  • Solid understanding of Apache Spark internals & tuning.
  • Expertise in SQL writing complex queries, optimizing joins, working with large datasets.
  • Familiar with data warehousing principles & modeling techniques (e.g., star/snowflake schemas).
  • Knowledge of Azure data services: Data Lake Storage, Synapse Analytics, SQL Database.
  • Experience implementing data governance, access control, and data lineage.

What You ll Do

Strong capability in architecting Databricks environments,and define data modeling strategy, including schema design, data structuring, and pipeline organization.

Design and implement robust, scalable, and efficient data pipelines using Databricks and ADF.
Leverage Unity Catalog to secure and govern sensitive data.
Optimize Databricks jobs & queries for speed, cost, and scalability.
Build and maintain Delta Lake tables and data models suitable for analytics and BI.
Collaborate with stakeholders to define data needs, provide solutions, and deliver business value.
Automate manual workflows, improve reliability, and ensure data quality.
Troubleshoot and monitor pipelines to guarantee uptime and data accuracy.
Mentor junior engineers and foster best practices in Databricks & Azure data engineering.

Preferred Background

  • 8 - 10 years in data engineering with a focus on Azure.
  • Demonstrated ability to work with large-scale distributed systems.
  • Strong communication and teamwork skills.
  • Certifications in Databricks and/or Azure Data Engineering are a plus.

Similar jobs