Senior Data Engineer - Fulltime

Job Title: Senior Data Engineer Location: Whippany, NJ (Hybrid, 2-3 days onsite in a week) Duration: Fulltime

Job Description:
Senior Data Engineer should have experience with
Hands on programming experience in python and PYSpark Advanced SQL skills with query optimization techniques
Strong understanding of AWS and distributed computing paradigms ability to design and develop data ingestion programs to process large data sets in Batch mode using Glue Lambda S3 redshift and data bricksBasic understanding of IAM roles security and AWS infrastructure
Hands on experience to work with large scale data platforms in development of cloud solutions in AWS data platform with proven track record in driving business success
Understanding of Dev Ops Pipelines using Jenkins GitLab should be strong in data modelling and Data architecture concepts well versed with Project management tools and Agile Methodology
Sound knowledge of data governance principles and tools alationglue data quality mesh Capable of suggesting solution architecture for diverse technology applications
Additional relevant skills given below are highly valued Good to have
Ability to develop data ingestion programs to ingest realtime data from LIVE sources using Apache Kafka Spark Streaming and related technologies
Understanding of DBT Data Build Tool for data transformation and modeling.