Quick Overview
Job Description
Position Overview:
We are seeking an experienced Mid - Senior Databricks Developer with 8–10+ years of industry experience to design, develop, and optimize large‑scale data solutions. The ideal candidate will have strong expertise in Databricks, Python, SQL, and Microsoft Azure cloud services. A minimum of a Bachelor’s degree is required.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL workflows using Databricks.
- Build and optimize Delta Lake architectures and data models.
- Develop high‑quality, reusable code in Python for data processing and automation.
- Write and optimize complex SQL queries for large datasets.
- Implement and manage solutions on Microsoft Azure, including Azure Data Lake, Azure Data Factory, and related services.
- Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver high‑quality solutions.
- Ensure data quality, reliability, and performance across all pipelines.
- Troubleshoot production issues and perform root‑cause analysis.
- Follow best practices for version control, CI/CD, and cloud security.
Required Qualifications:
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field (minimum requirement).
- 8–10+ years of experience in data engineering or software development.
- Strong hands‑on experience with Databricks (including notebooks, jobs, clusters, Delta Lake).
- Advanced proficiency in Python for data engineering.
- Strong expertise in SQL, including performance tuning.
- Solid experience with Microsoft Azure cloud services.
- Experience working with large‑scale distributed data systems.
- Strong problem‑solving skills and ability to work independently.
Preferred Skills (Nice to Have)
- Experience with CI/CD tools (Azure DevOps, GitHub Actions).
- Knowledge of Spark performance optimization.
- Experience with data governance and security frameworks.
- Familiarity with Agile methodologies.
Please share the candidate rating in the format provided below along with all required information.
Skill | Rate (0/10) |
Databrick experience | |
Python | |
SQL | |
Microsoft Assure Cloud | |
Experience with CI/CD |
Similar jobs
- GO
Senior Engineer
NewAuto ApplyGoodparty
Remote (United States)🇺🇸$200k - $235k/yrRemote1 hour agoLESSEngineering - AC
Full-Stack Engineer - Fleet Management
NewAuto ApplyATOMS Careers page
San Francisco🇺🇸Hybrid7 hours agoRoboticsFleet ManagementLESSTechnology - US
Senior Mainframe Developer – IMS Database & zOS
NewUSAA
PHOENIX, AZ🇺🇸$114.1k - $218.0k/yrHybridYesterdayScrumAgileCOBOL+1Technology - US
Senior Mainframe Developer – IMS Database & zOS
NewUSAA
San Antonio, TX🇺🇸$114.1k - $218.0k/yrHybrid5 hours agoScrumAgileCOBOL+1Technology - BA
ServiceNow Developer with Security Clearance
NewBooz Allen Hamilton
Washington, DC🇺🇸$86.8k - $198k/yrOn-siteYesterdayAgileTechnology - BA
Full Stack Software Engineer, Lead with Security Clearance
NewBooz Allen Hamilton
San Antonio, TX🇺🇸$112.9k - $257k/yrOn-siteYesterdayDockerGCPNext.js+15Technology - BA
CNO Developer with Security Clearance
NewBooz Allen Hamilton
Annapolis Junction, MD🇺🇸$86.9k - $198k/yrOn-siteYesterdayMachine LearningAgileAssembly+5Technology - BA
Full stack Software Engineer, Senior with Security Clearance
NewBooz Allen Hamilton
Dayton, OH🇺🇸$86.8k - $198k/yrOn-siteYesterdayDockerDynamoDBMicroservices+20Technology - BA
War Exercise Developer with Security Clearance
NewBooz Allen Hamilton
Arlington, VA🇺🇸$77.6k - $176k/yrOn-siteYesterdayTechnology - BA
Full Stack Software Engineer with Security Clearance
NewBooz Allen Hamilton
Washington, DC🇺🇸$69.4k - $158k/yrOn-siteYesterdayMicroservicesSQLScrum+11Technology - BA
AI Solution Developer with Security Clearance
NewBooz Allen Hamilton
Chantilly, VA🇺🇸$99k - $225k/yrOn-siteYesterdayGCPAWSAzure+3Technology - GO
Senior ServiceNow Developer
Govcio LLC
United States🇺🇸$130k - $160k/yrRemote4 days agoScrumAgileTechnology