Quick overview
Job description
Senior Data Engineer- SQL Server to Databricks Migration
Job Type: Contract (6-12 Months)- Possible extension
Location: Philadelphia, PA / Vienna, VA - Hybrid / Open to remote job
Job description:
ü Job summary
ü We are seeking a senior data engineer with deep Microsoft SQL Server experience to assess and convert a legacy warehouse to Azure Databricks.
ü You will read complex T-SQL stored procedures and SSIS packages, document the business rules they contain, rebuild them as Databricks pipelines, and reconcile the results before the legacy platform is retired.
Key responsibilities
ü Assess T-SQL stored procedures, SSIS packages and scheduled jobs for complexity, dependencies, and embedded business rules.
ü Recommend, for each object, whether to retire, convert or redesign it.
ü Convert legacy logic to Databricks SQL and PySpark pipelines using agreed patterns and conversion tooling.
ü Review and correct automatically converted code.
ü Build and run reconciliation between SQL Server and Databricks and resolve differences with business analysts.
ü Migrate job schedules and dependencies to Databricks workflows.
ü Support cutover and the evidence needed to decommission each legacy component.
ü Document data flows, mappings and design decisions in the client's repositories.
Required qualifications
ü 8+ years in data engineering or database development, including 5+ years of hands-on T-SQL and SSIS.
ü 2+ years building pipelines on Databricks, or an equivalent Spark-based lakehouse platform, with Delta Lake.
ü At least one completed migration from SQL Server or another warehouse to a cloud data platform.
ü Strong SQL performance tuning and the ability to reverse-engineer undocumented code.
ü Experience with data reconciliation and testing at scale.
ü Git-based development with pull requests and automated deployment.
Preferred qualifications
ü Databricks Lakeflow pipelines and jobs, and Unity Catalog.
ü Code-conversion tools such as Databricks Lakebridge.
ü Databricks Data Engineer Associate or Professional certification.
ü Financial services or wealth management data.
ü Experience with enterprise schedulers such as SQL Agent or ActiveBatch.
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- MR

Director of Data Engineering & Strategy | Addison, TX
Motion Recruitment Partners, LLC · Dallas, TX · Hybrid 🇺🇸
ETLSnowflakeSalary not listed - LT

Data Engineer with Security ClearanceRecently posted
L3Harris Technologies · Salt Lake City, UT · Hybrid · Posted 18 Nov 2026 🇺🇸
DockerMySQLSQL+21TechnologySalary not listed - CG
Senior Database Administrator with Security ClearanceRecently posted
Contact Government Services, LLC · Miami, FL · Hybrid · Posted 18 Nov 2026 🇺🇸
SQLAWSVMware+4Technology$89.3k - $121.2k/yr - CC

Snowflake ETL/ELT Data Engineer (Hybrid - Must be local to Denver CO)Recently posted
Cleo Consulting Inc. · United States · Hybrid · Posted 18 Nov 2026 🇺🇸
SQLGitETL+6TechnologySalary not listed - RI

Sr. Data EngineerRecently posted
Rivian · Atlanta, GA · Hybrid · Posted 18 Nov 2026 🇺🇸
PythonGenerative AIAgile+1Technology$111k - $138.7k/yr - BA

Data Engineer
Booz Allen Hamilton · Honolulu, HI · On-site 🇺🇸
AWSIoTLLM+4Technology$99k - $225k/yr - CI

Data Engineer - Vice President - CitiRecently posted
Citi · Tampa, FL · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerSQLScala+16Technology$113.8k - $170.8k/yr - AM

Data Engineer - SME (Team 09) with Security ClearanceRecently posted
Amentum · Washington, DC · On-site · Posted 18 Nov 2026 🇺🇸
SQLAWSConfluence+5Technology$200k - $225k/yr - RH

Sr. Data EngineerRecently posted
Robert Half · Bloomington, MN · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLApache SparkETL+14TechnologySalary not listed - RE

AI & Data EngineerRecently posted
Recruitment.ai · San Jose, CA · Hybrid · Posted 19 Nov 2026 🇺🇸
FastAPISQLAWS+8TechnologySalary not listed - SP

Data Infrastructure Operations Specialist II (Starlink)
SpaceX · Redmond, WA · Hybrid 🇺🇸
Continuous ImprovementProcurementSupply Chain Management+2Operations & Project Management$95k - $120k/yr - VS

Data Integration Engineer
Virtualan Software · Libertyville, IL · Hybrid · Posted 5 Nov 2026 🇺🇸
FastAPIMicroservicesSQL+7TechnologySalary not listed