Why this role stands out
Advance your career by joining a high-impact federal project where you will master scalable data pipelines and Databricks architecture while enjoying the flexibility of a hybrid work schedule. This role is perfect for a skilled data engineer who thrives in collaborative, Agile environments and wants to earn a competitive hourly rate while building sophisticated, reusable data products. Apply today to leverage your technical expertise and make a significant contribution to this large-scale agency modernization initiative.
Quick overview
Job description
What You Will Do
- Build and maintain Databricks ingestion, transformation, orchestration, migration, and data-processing pipelines.
- Develop scalable ETL/ELT solutions using Databricks, Apache Spark, PySpark, Python, SQL, and Delta Lake.
- Implement source-to-target mappings, transformation rules, business logic, data contracts, metadata, lineage, and data-quality requirements.
- Develop migrated data feeds, APIs, curated datasets, reporting layers, and reusable data products.
- Create reconciliation routines and support source-to-target validation, exception analysis, and defect resolution.
- Build unit, integration, regression, performance, and data-quality tests and document technical results.
- Support Git-based development, CI/CD, release management, deployment, monitoring, troubleshooting, and stabilization.
- Analyze and resolve job failures, cluster-performance issues, pipeline bottlenecks, schema changes, and data-quality problems.
- Collaborate with data architects, engineering leads, integration engineers, profiling analysts, testers, security specialists, governance leads, and source-system teams.
- Document reusable code, technical patterns, runbooks, troubleshooting procedures, and lessons learned for later modernization waves.
- Participate in Agile ceremonies, backlog refinement, sprint planning, demonstrations, and technical reviews.
What You Will Need
- Bachelor's degree in computer science, data engineering, information systems, engineering, analytics, or a related field.
- Minimum 4 years of experience in data engineering, software development, ETL/ELT, cloud analytics, or a related technical discipline.
- Hands-on experience with Databricks, Apache Spark, PySpark, Python, SQL, Delta Lake, and workflow orchestration.
- Experience building, testing, and maintaining batch data pipelines, transformations, and curated data layers.
- Experience with enterprise data migration, source-to-target mapping, reconciliation, validation, and data-quality controls.
- Familiarity with Git, CI/CD, automated testing, deployment, monitoring, logging, and troubleshooting.
- Strong analytical, problem-solving, documentation, collaboration, and communication skills.
- Ability to obtain and maintain a Federal Public Trust.
What Would Be Nice to Have
- Databricks Certified Data Engineer Associate or Professional certification.
- Experience with Unity Catalog, Delta Live Tables, Databricks Workflows, or Auto Loader.
- Experience developing APIs, integration pipelines, or data-consumption services.
- Experience with Azure DevOps, GitHub Actions, Jenkins, Terraform, or related engineering tools.
- Experience with streaming technologies such as Kafka or Azure Event Hubs.
- Experience migrating HR, ERP, workforce, financial, or sensitive enterprise data.
- Experience supporting federal agencies, regulated organizations, or public-sector modernization.
- Experience with Microsoft Azure or Amazon Web Services.
Medical, dental, and vision insurance are available to qualified candidates who meet eligibility requirements.
By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact:
This job and many more are available through The Judge Group. Please apply with us today!
Similar jobs
- CA
Data Designer
Carrier · Atlanta, GA · Hybrid 🇺🇸
RecruitingFigmaTableau+7$79k - $158k/yr - BR

Data Engineer/ArchitectRecently posted
Blue Rose Technologies LLC · Fremont, CA · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLApache SparkETL+3TechnologySalary not listed - MA

Snowflake AdminRecently posted
Magicforce · United States · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLGitAWS+7TechnologySalary not listed - ID
Sr AWS Data Engineer (with ETL, Python, AWS Glue, Lambda, Node.js & Microservices exp)Recently posted
Info Dinamica Inc · Malvern, PA · On-site · Posted 16 Nov 2026 🇺🇸
DynamoDBMicroservicesOracle+18TechnologySalary not listed - PG

Data Engineer – Databricks, PySpark, Cloud | Hybrid - 71701Recently posted
PRIMUS Global Services Inc. · Princeton, NJ · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLScalaApache Spark+4TechnologySalary not listed - PH

Data EngineerRecently posted
Photon · Sunnyvale, CA · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLAWSETL+6TechnologySalary not listed - GE

SQL Server DBARecently posted
Genesis10 · Charlotte, NC · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLShellMicrosoft Office+3Technology$53 - $61/hr - NT
Oracle DBA with Security ClearanceRecently posted
NorthHill Technology Resources · Fairfax, VA · Hybrid · Posted 17 Nov 2026 🇺🇸
MariaDBMongoDBOracle+6TechnologySalary not listed - IT

ETL LeadRecently posted
ITSYNTAX INC · Dallas, TX · Hybrid · Posted 16 Nov 2026 🇺🇸
OraclePL/SQLSQL+6Salary not listed - VI

Sr. Data EngineerRecently posted
Visa · Foster City, California · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLScalaApache Spark+14Technology$131.9k - $204k/yr - VI

Staff Data EngineerRecently posted
Visa · Foster City, California · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLScalaApache Spark+13Technology$156.8k - $251.1k/yr - FA

Systems Engineer (Data Flow/NiFi) Level 2Recently posted Auto Apply
Fantom Corporation · Fort Meade · On-site · Posted 17 Nov 2026 🇺🇸
ApacheComplianceComputer Vision+5TechnologySalary not listed
