Data Engineer / Lead Engineer / Architect

Job Summary

We are seeking a hands-on Lead Data Architect to lead the US architecture function for a multi-year data platform modernization program for a leading global financial services client. The initiative focuses on migrating on-premises Hadoop workloads to Snowflake.

The ideal candidate will own the target-state architecture, lead migration strategy and solution design, collaborate with senior client stakeholders, and guide an India-based delivery team through an AI-assisted migration approach. This role also requires strong client-facing solutioning skills, including identifying new business opportunities, developing proposals, and supporting account growth.

Key Responsibilities

• Define and own the target Snowflake architecture, including data modeling, data layers, ingestion frameworks, and transformation patterns.

• Lead Hadoop-to-Snowflake migration assessments and determine which workloads should be migrated, re-engineered, archived, or retired.

• Drive conversion of Hive, Spark, Python, and shell-based workloads to Snowflake SQL and Snowpark.

• Leverage AI-assisted code conversion tools with appropriate validation, code reviews, and quality controls.

• Establish migration validation strategies, including data reconciliation, data-quality checks, parallel runs, cutover planning, and rollback procedures.

• Collaborate with client architecture, security, governance, and compliance teams to define access controls, data retention, lineage, and regulatory requirements.

• Lead and mentor distributed engineering teams, including India-based delivery resources.

• Present architecture recommendations, migration roadmaps, and technical solutions to senior client stakeholders.

• Identify opportunities to expand the account through additional migration initiatives, data platform modernization, and AI-enabled data consumption.

• Develop solution proposals, estimates, delivery approaches, scope, risk assessments, and commercial inputs in collaboration with account, sales, and delivery leadership.

Required Qualifications

• 12+ years of experience in data engineering, data architecture, or large-scale data platform modernization.

• 4+ years of hands-on experience with Snowflake architecture and implementation.

• Proven experience delivering migrations from Hadoop-based platforms, including Cloudera, Hive, and Spark, to cloud data platforms.

• Strong proficiency in SQL, Python, and Apache Spark.

• Working knowledge of Snowpark, data pipeline orchestration, and CI/CD practices.

• Strong understanding of data modeling, data lineage, reconciliation, data quality, and governance in regulated environments.

• Experience leading distributed teams and managing complex, enterprise-scale migration programs.

• Excellent communication and stakeholder-management skills, with experience presenting to senior client architects and business leaders.

• Demonstrated experience in client-facing solutioning, proposal development, opportunity identification, and supporting business growth.