Lead Data Engineer

Job Description

Experienced Data management specialist responsible for developing, overseeing, organizing, storing, and analyzing data and data systems

Participate in all aspects of the software development lifecycle for Snowflake solutions, including planning, requirements, development, testing, and quality assurance

Work in tandem with our engineering team to identify and implement the most optimal solutions

Ensure platform performance, uptime, and scale, maintaining high standards for code quality and thoughtful design

Troubleshoot incidents, identify root causes, fix and document problems, and implement preventive measures

Able to manage deliverables in fast paced environments Areas of Expertise

At least 8-10 years of experience designing and development of data solutions in enterprise environment

At least 5+ years experience on Snowflake Platform

Strong hands on SQL and Python development

Experience with designing and development data warehouses in Snowflake

A minimum of three years experience in developing production-ready data ingestion and processing pipelines using Spark, Scala

Strong hands-on experience with Orchestration Tools e.g. Airflow, Informatica, Automic

Good understanding on Metadata and data lineage

Hands on knowledge on SQL Analytical functions

Strong knowledge and hands-on experience in Shell scripting, Java Scripting

Able to demonstrate experience with software engineering practices including CI/CD, Automated testing and Performance Engineering.

Good understanding and exposure to Git, Confluence and Jira

Good problem solving and troubleshooting skills.

Team player, collaborative approach and excellent communication skills