Data Engineer

At ValueMomentum s Engineering Centre, we are a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through strong engineering foundation and continuously refining our processes, methodologies, tools, agile delivery teams, and core engineering archetypes. Our core expertise lies in six key areas: Cloud Engineering, Application Engineering, Data Engineering, Core Engineering, Quality Engineering, and Domain expertise. Join a team that invests in your growth. Our Infinity Program empowers you to build your career with role-specific skill development leveraging immersive learning platforms. You'll have the opportunity to showcase your talents by contributing to impactful projects.

Role: Data Engineer - Local Candidates Preferred
Location: Missouri (Day 1 Onsite)

Position summary

The Data Engineer plays a critical, hands-on role in Microsoft Fabric and data modernization. This role applies Microsoft Fabric, Python/PySpark and SQL skills to migrate legacy SQL Server datamarts into reliable, modern analytics solutions. The Data Engineer takes meaningful ownership of development and delivery, collaborating with experienced teammates and business experts to turn complex data into trusted insights.

Key Responsibilities

• Re-engineer legacy SQL Server datamarts in Fabric, working with business experts to understand rules and dependencies and deliver tested migrations, parallel runs and controlled cutovers.
• Develop reusable Python, PySpark and Spark SQL transformations in Fabric notebooks and Lakehouses; build reliable pipelines with dependencies, retries, monitoring and safe reruns.
• Tune Spark workloads for performance and efficient Fabric capacity use, including joins, shuffles, skew, partitioning and memory.
• Implement incremental ingestion, change capture, upserts, schema evolution and backfills; build BI-ready dimensional models with clear grain, keys and history.
• Protect data accuracy with automated testing, quality checks and source-to-target reconciliation; troubleshoot production issues and improve reliability.
• Use Git, code review and CI/CD for deployment across environments; apply access controls, secure connectivity and data-protection practices with platform and security colleagues.
• Provide pragmatic support for selected legacy workloads during transition; Microsoft SQL Data marts.

Required Skills and Qualifications

• 5+ years of relevant data engineering or development experience, or equivalent demonstrated capability, with strong production Python/PySpark and SQL development skills.
• Bachelor s degree in Computer Science, Engineering or a related field, or equivalent relevant work experience.
• Hands-on Microsoft Fabric experience with Lakehouses, OneLake/Delta tables, notebooks and pipelines, plus production Python, PySpark and Spark SQL transformation, troubleshooting and performance tuning.
• Strong SQL Server and T-SQL skills, including stored procedures, execution-plan analysis and indexing; ability to translate existing business logic into modern pipelines.
• Practical dimensional-modeling skills and experience with incremental processing, schema changes, automated testing, data-quality controls and migration reconciliation.
• Proficiency with Git, CI/CD and environment-based deployment; practical knowledge of the on-premises data gateway for secure source connectivity.
• Ability to independently develop, test, deploy and troubleshoot assigned work within team architecture, seek design review and communicate clearly with technical and business colleagues.
• Sound judgment in protecting sensitive data and applying privacy, security and regulatory safeguards; commitment to documentation and knowledge sharing.

Preferred Qualifications

• Experience migrating SQL Server datamarts or transferable Spark experience from Microsoft Fabric, Databricks, or Azure Synapse.
• Advanced Power BI semantic-model development, including DAX, row-level security and Direct Lake.
• Banking or financial-services experience, or relevant Microsoft Fabric or data engineering certifications. Certifications are not required.

About ValueMomentum

ValueMomentum is a leading solutions provider for the global property and casualty insurance industry, supported by deep domain and technology capabilities. We help insurers stay ahead with sustained growth and high performance for enhancing stakeholder value and fostering resilient societies. Trusted by over 100 insurers, ValueMomentum is one of the largest services providers exclusively focused on property and casualty. ValueMomentum is headquartered in Piscataway, NJ, with state-of-the-art delivery centers in Piscataway, NJ; Hyderabad, Pune, and Coimbatore in India; Toronto in Canada; and London in the United Kingdom.

ValueMomentum is an Equal Opportunity Employer committed to fostering a diverse and inclusive workplace. We make all employment decisions based on qualifications, merit, and business needs, without regard to race, color, religion, sex, gender identity or expression, sexual orientation, national origin, age, disability, protected veteran status, genetic information, or any other characteristic protected by applicable federal, state, or local law. We are also committed to providing reasonable accommodations to qualified individuals with disabilities and applicants throughout the recruitment process, in accordance with applicable laws.