Back to Jobs
Other

Mng. Consultant - Databricks Data Engineering Lead

Judge Group, Inc.Arlington, VA🇺🇸United States

Why this role stands out

This high-impact role offers you the chance to drive large-scale data modernization for the federal government while enjoying the flexibility of a fully remote work environment and a highly competitive salary. You will thrive in this position if you are a skilled data engineer eager to advance your expertise in Databricks and Apache Spark within a collaborative, professional team. Apply today to accelerate your career and make a meaningful contribution to critical data infrastructure projects.

Quick overview

Salary$100k/yr
SeniorityMid Senior
Work modeHybrid
LocationArlington, VA, United States
SQLGitApache SparkETLApacheDatabricksPythonReconciliationAgileCI/CDDelta Lake

Job description

Location: Arlington, VA Salary: $120,000.00 USD Annually - $150,000.00 USD Annually Description:
Company: Supporting the Federal Gov
Positions: Mid, senior and lead Databricks openings
REMOTE
MUST BE PROCESSED FOR E PUBLIC TRUST CLEARANCE
Benefits: Healthcare and 401k
NOTE; FOR A QUICKER RESPONSE, PLEASE APPLY DIRECT TO and put "Databricks" on the subject line. Thank you!

Job Description Summary
Builds and tests Databricks pipelines, transformations, migration workflows, quality controls, APIs, curated datasets, reconciliation routines, and reusable data products supporting a large federal human-capital data modernization program. What You Will Do
Build and maintain Databricks ingestion, transformation, orchestration, migration, and data-processing pipelines. Develop scalable ETL/ELT solutions using Databricks, Apache Spark, PySpark, Python, SQL, and Delta Lake.

Implement source-to-target mappings, transformation rules, business logic, data contracts, metadata, lineage, and data-quality requirements. Develop migrated data feeds, APIs, curated datasets, reporting layers, and reusable data products. Create reconciliation routines and support source-to-target validation, exception analysis, and defect resolution. Build unit, integration, regression, performance, and data-quality tests and document technical results. Support Git-based development, CI/CD, release management, deployment, monitoring, troubleshooting, and stabilization.

Analyze and resolve job failures, cluster-performance issues, pipeline bottlenecks, schema changes, and data-quality problems. Collaborate with data architects, engineering leads, integration engineers, profiling analysts, testers, security specialists, governance leads, and source-system teams. Document reusable code, technical patterns, runbooks, troubleshooting procedures, and lessons learned for later modernization waves. Participate in Agile ceremonies, backlog refinement, sprint planning, demonstrations, and technical reviews.

What You Will Need
Bachelor's degree in computer science, data engineering, information systems, engineering, analytics, or a related field. Minimum 4 years of experience in data engineering, software development, ETL/ELT, cloud analytics, or a related technical discipline. Hands-on experience with Databricks, Apache Spark, PySpark, Python, SQL, Delta Lake, and workflow orchestration. Experience building, testing, and maintaining batch data pipelines, transformations, and curated data layers.

Experience with enterprise data migration, source-to-target mapping, reconciliation, validation, and data-quality controls. Familiarity with Git, CI/CD, automated testing, deployment, monitoring, logging, and troubleshooting. Strong analytical, problem-solving, documentation, collaboration, and communication skills. Ability to obtain and maintain a Federal Public Trust. Medical, dental, and vision insurance are available to qualified candidates who meet eligibility requirements.

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.

Contact

This job and many more are available through The Judge Group. Please apply with us today!

Similar jobs