Data Engineer

Job Title: Data Engineer

Job location: New York City, NY (Hybrid, 3 days in a week)

Job Type: W2 Contract

Job Description:

Looking for skilled Data engineer with comprehensive experience in designing, developing, and maintaining scalable data solutions within the financial and regulatory domains. Proven expertise in leading end-to-end data architectures, integrating diverse data sources, and ensuring data quality and accuracy.

Core Competencies:

• Advanced proficiency in Python, SQL Server, Snowflake, Azure Databricks, and PySpark.
• Strong understanding of relational databases, ETL processes, and data modeling.
• Expertise in system design, architecture, and implementing robust data pipelines.
• Hands-on experience with data validation, quality checks, and automation tools (Autosys, Control-M).
• Effective communicator with the ability to collaborate with business analysts, users, and global teams.

Key Responsibilities:

• Collaborate with business stakeholders to gather technical specifications and translate business requirements into technical solutions.
• Develop and optimize data models and schemas for efficient data integration and analysis.
• Lead application development involving Python, Pyspark, SQL, Snowflake, and Databricks platforms.
• Implement data validation procedures to maintain high data quality standards.
• Conduct comprehensive testing (UT, SIT, UAT) alongside business and testing teams.
• Provide ongoing support, troubleshooting, and maintenance in production environments.
• Contribute to architecture and design discussions to ensure scalable, maintainable data solutions.
• Experience with financial systems (capital markets, credit risk, and regulatory compliance applications).