Haystack
← Back to Jobs
Technology
CO

Data Engineer SQL to Microsoft Fabric Modernization/Migration

Compunnel Inc.San Antonio, TX🇺🇸United StatesPosted Sep 17, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
San Antonio, TX, United States
Posted
21 hours ago
SQLT-SQLApacheApache Spark

Job Description

Key Responsibilities
Transform existing SQL stored procedures into Microsoft Fabric notebooks to create Silver-layer tables within the Fabric Lakehouse
Ensure Fabric tables match the corresponding on-premises SQL tables on a one-to-one basis
Design and develop orchestration frameworks using Microsoft Fabric data pipelines
Validate migration artifacts, including reconciliation results and supporting evidence
Develop repeatable validation tests that can run consistently on a daily basis
Perform data reconciliation and validation to verify accuracy, completeness, and consistency between Fabric and on-premises SQL tables
Build and maintain the Silver layer within the Medallion architecture
Work with Microsoft Fabric data flows, data pipelines, Lakehouse structures, orchestration, and scheduling capabilities
Support the migration of SQL logic and stored procedures into Fabric notebooks while maintaining expected functionality and data results
Identify and troubleshoot discrepancies between migrated Fabric tables and on-premises SQL tables
Create and maintain technical documentation describing implemented solutions, processes, migration activities, and validation approaches

Required Qualifications
5+ years of experience
Bachelor's Degree

Skills
SQL
T-SQL
Apache Spark
Microsoft Fabric
PySpark
Spark SQL
Lakehouse Architecture
Medallion Architecture
Microsoft Fabric Data Pipelines and Orchestration
Metadata-Driven Frameworks
Data Migration
Data Validation and Reconciliation
Technical Documentation
Analytical Problem Solving
Orchestration Framework Development

Schedule
Start date: 2026-09-28

Similar jobs