Haystack
← Back to Jobs
Remote
Technology
PA

Microsoft Fabric Data Engineer - Healthcare (Fully Remote)

Palni IncUnited States🇺🇸United StatesPosted Sep 24, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Remote
Location
United States
Posted
23 hours ago
SQLSQL ServerETLAgileAzureGitPower BI

Job Description

Microsoft Fabric Data Engineer

Experience: 5-10 Years (5+ years with Azure / Microsoft Fabric required)

Location: USA (Remote)

Employment Type: Contract

Key Responsibilities

Data Migration & Engineering

  • Migrate data from Azure SQL databases and legacy ETL pipelines into Microsoft Fabric.
  • Redesign ETL processes and rebuild using Fabric capabilities.
  • Implement Medallion architecture (Bronze, Silver, Gold).
  • Design and Develop efficient ingestion, transformation, and orchestration pipelines.

Fabric Data Development

  • Build and manage pipelines using Fabric Data Factory.
  • Develop transformations using Spark notebooks (PySpark/SQL).
  • Create and model Fabric Warehouses.
  • Work with OneLake for unified storage and data access.

Performance & Optimization

  • Optimize Spark jobs, pipelines, and warehouse queries for performance.
  • Implement partitioning, incremental loads, and CDC patterns.
  • Ensure data quality, consistency, and reliability.

Security & Governance

  • Work with Fabric administrators on RBAC, workspace design, and data access controls.
  • Apply data governance standards including naming conventions, lineage, and metadata.
  • Support integration with Microsoft Purview.

DevOps & Automation

  • Implement CI/CD pipelines for Fabric artifacts using Git/Azure DevOps.
  • Support environment promotion (Dev → Test → Prod).
  • Automate deployments and data validation checks.

Collaboration & Support

  • Collaborate with BI teams to enable Power BI semantic models and reporting.
  • Work with stakeholders to understand data requirements and SLAs.
  • Provide production support and troubleshooting.

Required Skills & Qualifications

Technical Skills

  • Strong experience in data engineering using Microsoft Azure.
  • Hands-on experience with Microsoft Fabric, including: 
    • Fabric Data Factory
    • Lakehouse & OneLake
    • Spark / Notebooks
    • Fabric Data Warehouse
  • Experience with Azure SQL, SQL Server, and relational databases.
  • Strong SQL and PySpark skills.
  • Knowledge of modern data architectures (Lakehouse, ELT, Medallion).
  • Experience with data migration and modernization projects.

 

Preferred / Nice-to-Have Skills

  • Power BI (data modeling, performance tuning).
  • Microsoft Purview / data governance tools.
  • CDC, event-driven ingestion, or streaming experience.
  • Fabric or Azure Data Engineer certifications.

Soft Skills

  • Strong analytical and problem-solving skills.
  • Ability to work in agile delivery models.
  • Clear communication with technical and non-technical stakeholders.
  • Ownership mindset for data reliability and quality.

Key Deliverables

  • Successfully migrated data platform from Azure SQL + ETL to Microsoft Fabric.
  • Scalable and performant Fabric data pipelines.
  • Analytics-ready datasets supporting enterprise reporting and insights

 

 

Similar jobs