Principal Data Engineering: Databricks

We are looking for a Principal Data Engineer to join a world-leading Energy Trading company to lead, design and build data foundations and end-to-end solutions for the Business to maximize value from data.

The candidate is expected to be a subject matter expert who designs and builds data solutions while also mentoring junior engineers. They are also a key driver in translating Vision and Data Strategy into IT solutions and delivering on them.

Strong hands-on expertise in Databricks, PySpark, Python and SQL is central to this role.

Key Skills

Azure Stack
ELT Experience
Data Modeling
Data Integration & Ingestion
Data Manipulation and Processing
GitHub, GitHub Actions, Azure DevOps
Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest

Key Characteristics

Technology expert who constantly pursues knowledge enhancement and has an inherent curiosity to understand work from multiple dimensions.
Deep data focus with expertise across relevant technology domains.
A skilled communicator capable of engaging both technical developers and business managers; respected and trusted by leaders and staff.
Actively delivers the roll-out and embedding of Data Foundation initiatives in support of key business programs.
Coordinates the change management, incident management, and problem management processes.
Presents reports and findings to key stakeholders and acts as the subject matter expert on Data Analysis & Design.
Drives implementation efficiency and effectiveness across pilots and future projects to minimize cost, increase speed of delivery, and maximize value.
Contributes to community-building initiatives such as Centers of Excellence (CoE) and Communities of Practice (CoP).

With a focus within Energy Trading, Oil & Gas, Financial Markets and Commodities, we offer a transparent Recruitment Service that has proven to be reliable and effective for over 40 years. We are ISO accredited and proud of our excellent TrustPilot Reviews. Your search for a New Contract Assignment or for a New Permanent Job will be in safe hands with Eaglecliff Recruitment. Please telephone for an immediate response or email your CV for a quick response. Eaglecliff Ltd is acting in the capacity of an employment agency for permanent recruitment and an employment business for contractor resourcing.agency for permanent recruitment and an employment business for contractor resourcing.