Back to Jobs
Recently postedTechnology

Databricks Data/ETL Developer

SmallArc, IncUnited States🇺🇸United States

Quick overview

Work modeHybrid
LocationUnited States
SQLGitApache SparkETLDatabricksAzureCI/CDDelta LakeIAM

Job description

Required Skills:

Good customer presence and ability to answer a variety of Databricks questions

  • GitHub and CI/CD experience is a plus Day-to-day Responsibilities:
  • Design, develop, and maintain data engineering pipelines in Databricks using PySpark or SQL
  • Experience developing streaming pipelines using Databricks Autoloader or Structured Streaming
  • Data Modeling experience designing Delta Lake tables and the Bronze-Silver-Gold Medallion Architecture
  • Understanding of Spark for performance optimizations including Delta Lake optimizations
  • Experience with cloud service provider (Azure) services used in Databricks’ implementations (e.g., Azure ALDS, IAM)
  • Triaging ad hoc questions across the Databricks product suite Certifications

Preferred Skills:
FiveTran Responsibilities: Support ETL and CI/CD pipelines to create tables in the data lake. Support data refresh and reconciliation processes to validate data accuracy. Expected Deliverable(s): Data pipelines, tables, row-level security configurations, and ETL processes to automatically update datasets daily

Will your resume get past this employer's screening? Check your resume against this job, free

Similar jobs