Databricks Data Engineer

Need (Federal/HHS/FDA/NIH Experince is required)

Databricks Data Engineer

Washington, DC metropolitan area – Hybrid / Onsite.

Long Term

Job Description:

We are seeking a Databricks Data Engineer with strong hands-on experience in Python and PySpark to support a fast-paced, high-impact delivery environment. This role requires someone who can quickly step in, take ownership, and deliver scalable data solutions with minimal ramp-up.

Key Responsibilities

• Design, develop, and optimize data pipelines and ETL workflows using Databricks.
• Build scalable data processing solutions leveraging PySpark and Python.
• Work with large-scale datasets across cloud platforms (AWS and/or Azure).
• Implement and maintain Medallion Architecture (Bronze, Silver, Gold layers).
• Ensure data quality, performance optimization, and reliability of data pipelines.
• Collaborate with cross-functional teams to support data-driven initiatives.

Required Qualifications

3 to 5 years of experience in Databricks is required.

• Strong hands-on experience with Databricks, Python, PySpark, and SQL.
• Proven experience building and optimizing ETL pipelines.
• Experience working with large-scale data environments.
• Solid understanding of cloud platforms (AWS and/or Azure).
• Familiarity with Medallion Architecture (Delta Lake).
• Ability to work independently in fast-paced, deadline-driven environments.

What We're Looking For

• Someone who can hit the ground running with minimal onboarding.
• Strong sense of ownership and accountability.
• Ability to deliver under tight timelines without compromising quality.
• Proactive problem-solver with a delivery-first mindset.