Senior Data Engineer

Role: Senior Data Engineer

Location:  Remote

Duration: 6+ Month Contract

Job Summary

We are seeking a hands-on Senior Data Engineer with 5+ years of experience building and supporting enterprise-scale data platforms. The ideal candidate will have strong expertise in AWS, Python, SQL, ETL/ELT development, data integration, and modern data engineering practices. This role will be responsible for designing, developing, and optimizing scalable data pipelines that support analytics, reporting, and business operations.

Key Responsibilities

• Design, build, and maintain production-grade data pipelines using AWS, Apache Airflow, Matillion, AWS Glue, and SSIS.
• Develop scalable batch, real-time, and CDC-based data integration solutions.
• Integrate data from SAP/S4, ERP, CRM, e-commerce platforms, APIs, SFTP, and other enterprise systems.
• Build data solutions using SQL, Python (Pandas, PySpark), Kafka, Kinesis, and Debezium.
• Implement data quality, observability, monitoring, alerting, and lineage frameworks.
• Perform root-cause analysis, troubleshooting, and performance tuning of data pipelines and SQL workloads.
• Design dimensional and domain-driven data models to support analytics and BI platforms such as Power BI and Qlik.
• Develop and maintain CI/CD pipelines using Git, GitHub Actions, Terraform, and Infrastructure-as-Code practices.
• Collaborate with Analytics, DevOps, Security, and Business teams in an Agile environment.

Required Skills & Qualifications

• 5+ years of hands-on Data Engineering experience supporting mission-critical production environments.
• Strong experience with AWS (preferred) or similar cloud platforms.
• Advanced SQL skills (T-SQL, Redshift SQL) with performance tuning expertise.
• Strong Python development experience, including Pandas and PySpark.
• Hands-on experience with Airflow, AWS Glue, Matillion, and SSIS.
• Experience with ETL/ELT, data warehousing, data lakes, and modern orchestration frameworks.
• Experience integrating SAP, ERP, CRM, and other enterprise applications.
• Strong understanding of batch processing, streaming, and Change Data Capture (CDC) architectures.
• Experience with Kafka, Kinesis, and Debezium.
• Experience designing dimensional and domain-driven data models.
• Knowledge of relational, columnar, and graph databases (Neo4j, Neptune preferred).
• Hands-on experience with Git, GitHub Actions, and CI/CD automation.
• Strong communication, problem-solving, and stakeholder management skills.
• Experience working in Agile/Scrum environments.