Lead Data Engineer (Final round in person at NYC)

Lead Data Engineer New York City, NY

• Advanced proficiency in Python, SQL Server, Snowflake, Azure Databricks, and PySpark.
• Strong understanding of relational databases, ETL processes, and data modeling.
• Expertise in system design, architecture, and implementing robust data pipelines.
• Hands-on experience with data validation, quality checks, and automation tools (Autosys, Control-M).
• Effective communicator with the ability to collaborate with business analysts, users, and global teams.

• Collaborate with business stakeholders to gather technical specifications and translate business requirements into technical solutions.
• Develop and optimize data models and schemas for efficient data integration and analysis.
• Lead application development involving Python, Pyspark, SQL, Snowflake, and Databricks platforms.
• Implement data validation procedures to maintain high data quality standards.
• Conduct comprehensive testing (UT, SIT, UAT) alongside business and testing teams.
• Provide ongoing support, troubleshooting, and maintenance in production environments.
• Contribute to architecture and design discussions to ensure scalable, maintainable data solutions.
• Experience with financial systems (capital markets, credit risk, and regulatory compliance applications).