Quick overview
SeniorityMid Senior
Work modeHybrid
LocationUnited States
Posted3 weeks ago
Unity
Job description
Position: Senior Databricks Data Engineer
Location: Remote / Hybrid
Duration: Long Term
Responsibilities
- Develop scalable data pipelines using Databricks, PySpark and SQL.
- Build and maintain Delta Lake tables using the Medallion Architecture.
- Develop batch and real-time data processing pipelines.
- Implement data ingestion using Auto Loader, APIs, Kafka or cloud storage.
- Optimize Spark jobs, SQL queries and Delta tables.
- Implement data governance and security using Unity Catalog.
- Develop Databricks Workflows/Jobs and monitor production pipelines.
- Integrate Databricks with AWS/Azure/Google Cloud Platform data services.
- Implement CI/CD and source-code management using Git and DevOps tools.
- Collaborate with data architects, analysts, ML engineers and business teams.
Sincerely,
Sr. Manager
nFolks Data Solutions LLC
Phone:
Email:
Similar jobs
- CT
Big Data EngineerNew
ConsultNet Technology Services and Solutions · Rockville, Maryland · Hybrid 🇺🇸
SQLApache SparkAWS+5TechnologySalary not listed35 minutes ago - YA
Data Engineer w/Azure Databrick & Spark- Onsite NJ- GC and USC only- no corpsNew
Yoh, A Day & Zimmermann Company · New Jersey · Hybrid 🇺🇸
SQLGitApache Spark+17TechnologySalary not listed35 minutes ago - LS
Senior Data Engineer (ETL/Cloud) - 50% telework with Security ClearanceNew
Linchpin Software · Chantilly, VA · Remote 🇺🇸
ElixirFlaskSQL+16TechnologySalary not listedYesterday - CH

Data Visualization Engineer with Security ClearanceNew
Chenega Corporation · Redstone Arsenal, AL · Hybrid 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft PowerPoint+2EngineeringSalary not listed2 days ago - ZE

Senior Data Base Engineer Auto Apply
Zeta · Basking Ridge · On-site 🇺🇸
ComplianceInstagramYouTubeEngineeringSalary not listed5 months ago - ZO

AV Safety Data Reporting Engineer Auto Apply
Zoox · Foster City · Hybrid 🇺🇸
ComplianceRisk AssessmentTriage+1Engineering$160k - $221k/yr1 year ago - XC

Data Engineer Auto Apply
Xcimer · Denver · On-site 🇺🇸
Technology$125k - $160k/yr6 weeks ago - WY

Database Engineer 3 Auto Apply
Wyetechllc · Annapolis Junction · On-site 🇺🇸
Technology$64 - $116/hr3 months ago - WY

Database Engineer 3 Auto Apply
Wyetechllc · Linthicum Heights · On-site 🇺🇸
Technology$64 - $116/hr11 months ago - WY

Database Engineer 0 Auto Apply
Wyetechllc · Annapolis Junction · On-site 🇺🇸
Technology$50 - $81/hr1 year ago - WY

Database Engineer 2 Auto Apply
Wyetechllc · Linthicum Heights · On-site 🇺🇸
DjangoFlaskMariaDB+5TechnologySalary not listed2 years ago - WI

Senior Data Engineer Auto Apply
Windfalldata · San Francisco or Denver · Hybrid 🇺🇸
Technology$170k - $220k/yr4 months ago