Quick Overview
Seniority
Mid Senior
Work mode
On Site
Location
Parsippany-Troy Hills, NJ, United States
Posted
22 hours ago
SQLAWSETLNumPyAzureDatabricksJenkinsPandasPythonUnity
Job Description
Hi,
Position: Data Engineer
Location: Parsippany NJ / 3x per week onsite
Duration: 12+ month contract
Need Locals
W2 requirement || C2C not possible
Requirements:
- Top Must-Haves:
- **-30% cleaning and handle, 30% building the pipeline, 30 % analytical skills
- 7+ years (around that) of experience in Data Engineering or Data Platform development.
- Finance or payroll domain experience is ideal— understands payroll data structures, pay period logic, compensation/deduction relationships, or has worked in financial services data environments.
- Experience handling large-scale datasets (billions of records, multi-TB, time-series data).
- Aws cloud experience (or azure cloud if databricks exp is there)
- Strong Databricks proficiency with deep understanding of:
- Unity Catalog (governance, access patterns, catalog/schema design)
- Delta Lake internals (optimization, clustering, change data feed, versioning)
- Databricks Workflows (orchestration, dependencies, monitoring)
- Databricks Asset Bundles (Declarative automation bundles) or equivalent deployment frameworks
- Exposure to architecture-level design decisions (can participate in architecture discussions, understands tradeoffs).
- Strong proficiency in:
- Python
- SQL
- PySpark
- Data Modeling
- ETL/ELT Development
- Analytical fluency: exploratory data analysis, basic statistical concepts (correlation, distributions, time-series patterns), feature engineering support.
- Proficiency with pandas/numpy for ad-hoc analytical work alongside production PySpark.
- CI/CD implementation experience (Bitbucket Pipelines, Jenkins, automated deployment).
- Proficiency with AI-assisted development tools (GitHub Copilot, Amazon Q, Kiro, or equivalent).
- Data quality and validation frameworks
Similar jobs
- PE
Senior Data Engineer with Security Clearance
NewPrescient Edge
Augusta, GA🇺🇸Hybrid22 hours agoMATLABSQLScala+5Technology - RH
Senior Data Engineer with Security Clearance
NewRiver Hawk Consulting LLC
Mc Lean, VA🇺🇸Hybrid22 hours agoSQLAWSAgile+2Technology - FI
Data Engineer
NewFindem Inc.
McLean, VA🇺🇸Hybrid22 hours agoSQLAWSETL+8Technology - PE
Senior Data Engineer with Security Clearance
NewPrescient Edge
Washington, DC🇺🇸$160k - $180k/yrHybrid22 hours agoSQLETLData PipelineTechnology - PE
Mid Data Engineer with Security Clearance
NewPrescient Edge
Washington, DC🇺🇸$130k - $160k/yrHybrid22 hours agoSQLETLData PipelineTechnology - AS
Data Engineer
NewAgreeYa Solutions
El Segundo, CA🇺🇸Hybrid22 hours agoSQLAWSETL+6Technology