Back to Jobs
Recently postedRemoteFull timeTechnology

Data Engineer (Databricks & Fabric) - Remote

CandidHRAustralia🇦🇺Australia

Quick overview

SeniorityMid Senior
Employment typeFull Time
Work modeRemote
LocationAustralia
SQLAWSETLData PipelineDatabricksPythonAzureMachine Learning

Job description

Job Description About the Role

We are seeking a highly skilled and experienced Data Engineer specializing in Databricks and Fabric to join our dynamic team. In this remote position, you will play a pivotal role in designing and implementing robust data pipelines and data solutions that drive business insights and decision-making. Your expertise will help us leverage Databricks and Fabric to enhance our data processing capabilities, ensuring scalability and performance. If you are passionate about data engineering and are looking to make a significant impact.

Key Responsibilities
  • Design, develop, and maintain scalable data pipelines using Databricks and Fabric.
  • Implement data transformation processes that ensure data quality and integrity.
  • Collaborate with data scientists and analysts to understand data needs and deliver reliable data solutions.
  • Optimize data storage and processing performance for large datasets.
  • Monitor and troubleshoot data pipeline performance issues, ensuring minimal downtime.
  • Documentation of data engineering processes and best practices.
  • Mentor junior data engineers and promote knowledge sharing within the team.
Required Qualifications
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience in data engineering, with a focus on Databricks and Fabric.
  • Strong proficiency in SQL, Python, and Spark.
  • Experience with data modeling and ETL best practices.
  • Familiarity with cloud data platforms (e.g., Azure, AWS).
  • Ability to work independently and collaboratively in a remote team environment.
Preferred Qualifications
  • Master's degree in a relevant field.
  • Experience with real-time data processing frameworks.
  • Knowledge of data governance and compliance standards.
  • Familiarity with Machine Learning concepts and tools.

Similar jobs