Principal Data Engineer

Description

We are looking for a Principal Data Engineer to shape and lead a modern enterprise data platform serving multiple business lines. This position will define the architectural direction for a Microsoft Fabric-based environment, guide engineering best practices, and partner closely with data and IT leaders to support long-term growth. The role is ideal for a senior technical expert who combines deep hands-on engineering capability with strong mentorship and platform strategy experience.

Responsibilities

Lead the design and ongoing evolution of a Microsoft Fabric lakehouse environment, establishing a scalable architecture across raw, refined, and curated data layers.

Create and support robust data integration workflows that bring information together from more than 30 enterprise applications and operational platforms.

Set technical standards for data engineering, including coding practices, solution design patterns, documentation, and review processes.

Mentor data engineers through hands-on coaching, collaborative development, and detailed code feedback to strengthen team capability.

Partner with data and IT leadership to align platform architecture with business priorities and future expansion needs.

Develop high-quality data pipelines using modern tools and frameworks such as SQL, Python, Spark, and PySpark within cloud-based data ecosystems.

Evaluate new technologies, architectural approaches, and data platform trends, then provide informed recommendations for adoption.

Support governance and platform reliability by promoting strong lineage, quality, performance, and scalable engineering practices.

Contribute to cross-platform interoperability initiatives, including environments that may involve Databricks, governance tooling, and enterprise data services.

Requirements

Bachelor's degree in Computer Science, Data Science, Mathematics, Engineering, Business Analytics, or a related discipline; comparable relevant experience may be considered. At least 10 years of progressive data engineering experience with increasing technical leadership and architectural responsibility. Advanced expertise with Microsoft Fabric, including lakehouse design, pipelines, dataflows, notebooks, semantic models, and related platform capabilities.

Strong command of modern cloud data technologies such as Azure Data Factory, Azure Data Lake, Delta Lake, and enterprise-scale ETL and ELT frameworks. Expert-level proficiency in SQL and Python, along with practical experience building solutions with Spark or PySpark. Demonstrated success designing and implementing medallion-style lakehouse architectures or similar large-scale data platform models. Experience integrating enterprise systems such as ERP, HR, CRM, service management, or field operations tools into a centralized data environment.

Familiarity with Databricks, Unity Catalog, Microsoft Purview, or relevant Microsoft and Azure data certifications is valued.

Technology Doesn't Change the World, People Do.

Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.

All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.

2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use and Privacy Notice.