Data Engineer

Senior Data Engineer

Experience: 10+ Years Employment Type: W2 only


Job Description
We are seeking a highly skilled Senior Data Engineer with 10+ years of experience designing, building, and optimizing large-scale data pipelines and infrastructure. The ideal candidate will have deep expertise in data warehousing, ETL/ELT development, cloud data platforms, and big data technologies, with a proven ability to architect solutions that drive business intelligence and analytics at scale.

Key Responsibilities

• Design, develop, and maintain scalable, robust ETL/ELT pipelines to ingest, transform, and load data from diverse sources
• Architect and optimize data warehouse/data lake solutions (Snowflake, Redshift, Databricks, BigQuery)
• Build and manage batch and real-time data pipelines using tools like Apache Spark, Airflow, Kafka
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver reliable datasets
• Design and implement data models (star/snowflake schema, dimensional modeling) for analytics and reporting
• Ensure data quality, integrity, governance, and security across pipelines and platforms
• Optimize SQL queries and pipeline performance for large-scale datasets
• Work with cloud platforms (AWS, Azure, or Google Cloud Platform) to build and deploy data infrastructure
• Implement CI/CD practices for data pipeline deployment and version control
• Monitor, troubleshoot, and resolve data pipeline issues, ensuring high availability and reliability
• Mentor junior data engineers and enforce best practices in data engineering
• Document data architecture, pipelines, and processes for maintainability

Required Skills & Qualifications

• 10+ years of professional experience in data engineering or related roles
• Strong proficiency in Python and/or Scala for data pipeline development
• Expert-level SQL skills with experience in query optimization and performance tuning
• Hands-on experience with Apache Spark, Hadoop ecosystem, Kafka
• Strong experience with orchestration tools like Apache Airflow, Azure Data Factory, or AWS Glue
• Deep expertise in cloud data platforms — AWS (Redshift, S3, EMR), Azure (Synapse, Data Lake), or Google Cloud Platform (BigQuery, Dataflow)
• Experience with modern data warehouse platforms (Snowflake, Databricks)
• Solid understanding of data modeling techniques (dimensional modeling, star/snowflake schema)
• Experience with version control (Git) and CI/CD pipelines for data workflows
• Familiarity with containerization (Docker, Kubernetes) for data pipeline deployment
• Strong understanding of data governance, security, and compliance practices
• Experience working in Agile/Scrum environments
• Excellent analytical, problem-solving, and communication skills
• Bachelor''s/Master''s degree in Computer Science, Data Engineering, or related field