Quick Overview
Seniority
Mid Senior
Work mode
On Site
Location
Charlotte, NC, United States
Posted
20 hours ago
SQLAWSETLApacheApache SparkAzureData PipelineDatabricksGitGoogle CloudPython
Job Description
Role : Databricks Data Engineer
Location: Charlotte, NC – Onsite
Key Responsibilities:
Location: Charlotte, NC – Onsite
Key Responsibilities:
- Design and develop scalable data pipelines using Databricks and Apache Spark.
- Develop ETL/ELT processes using Python/PySpark and SQL.
- Work with Delta Lake for data storage and processing.
- Build and optimize data workflows and notebooks in Databricks.
- Perform data transformation, cleansing, and validation.
- Optimize Spark jobs and SQL queries for performance.
- Work with cloud data platforms and storage services.
- Implement data quality, monitoring, and troubleshooting processes.
- Collaborate with data architects, analysts, and business teams.
- Follow best practices for Git, CI/CD, and data engineering.
- Strong experience with Databricks
- Hands-on experience with Apache Spark / PySpark
- Strong Python and SQL
- Experience with Delta Lake
- Strong ETL/ELT and data pipeline development experience
- Experience with cloud platforms such as Azure, AWS, or Google Cloud Platform
- Experience with data warehouse/lakehouse concepts
- Git and CI/CD experience
- Strong troubleshooting and performance-tuning skills
Similar jobs
- BL
Senior Data Engineer (ONLY FULLTIME)
NewBlackstraw LLC
United States🇺🇸Hybrid2 days agoSQLMLflowMachine Learning+11Technology - BA
Database Engineer with Security Clearance
NewBooz Allen Hamilton
Fayetteville, NC🇺🇸$77.5k - $176k/yrOn-site20 hours agoSQLAWSEncryption+4Technology - BA
Palantir Data Engineer with Security Clearance
NewBooz Allen Hamilton
Springfield, VA🇺🇸$77.6k - $176k/yrOn-site20 hours agoMachine LearningAgileGit+3Technology - BA
Data Engineer with Security Clearance
NewBooz Allen Hamilton
Hanscom AFB, MA🇺🇸$61.9k - $141k/yrOn-site20 hours agoAWSMachine LearningAgile+3Technology - EG
Senior AI Data Engineer
NewEnexus Global
New York, NY🇺🇸Hybrid20 hours agoNeo4jSQLAWS+11Technology - IC
Senior Data Engineer- 7+ yrs- New York, United States- Onsite
NewiMedhas Consulting Services
New York, NY🇺🇸Hybrid20 hours agoSQLShellAWS+5Technology