Quick overview
Job description
Job requirements
- Design and architect scalable data pipelines and solutions using AWS native services to support complex business requirements
- Develop, implement, and optimize ETL processes leveraging AWS technologies such as EMR, Redshift, Athena, and DMS
- Configure and manage real-time data streaming and ingestion frameworks utilizing Kinesis and Amazon API Gateway
- Monitor, troubleshoot, and enhance data infrastructure performance using CloudWatch and Open Search
- Automate deployment and infrastructure provisioning with CloudFormation and manage schema migrations using SCT
- Lead the implementation and integration of Master Data Management (MDM) solutions using Stibo within enterprise data platforms
- Collaborate with cross-functional teams to integrate data solutions with enterprise applications and analytics platforms
- Ensure data security, quality, and compliance by implementing best practices and leveraging AWS security features
- Lead technical reviews, mentor junior engineers, and drive adoption of emerging data technologies within the organization
- Advanced proficiency in AWS services including SNS, SQS, Amazon API Gateway, Athena, CloudFormation, CloudWatch, DMS, DynamoDB, EMR, Kinesis, Open Search, Redshift, SCT
- Expertise in designing and managing data pipelines and ETL workflows on AWS
- Strong experience with Spark using Scala for large-scale data processing
- Hands-on experience with Oozie workflow scheduling and orchestration
- Deep knowledge of real-time data streaming with AWS Kinesis
- Proven ability to configure and optimize Amazon Redshift for analytics workloads
- Experience with DynamoDB for NoSQL database solutions
- Ability to automate infrastructure and deployments using AWS CloudFormation
- Proficient in monitoring and logging with AWS CloudWatch
- Skill in managing data migration and schema transformation using AWS SCT and DMS
- Demonstrated expertise in implementing and integrating MDM solutions using Stibo
- Experience integrating AWS data solutions with third-party analytics and visualization tools
- Proficiency in optimizing performance for large-scale distributed data systems
- Knowledge of emerging AWS data services and staying current with industry best practices
- Experience with Open Search for search and analytics use cases
- Background in mentoring and leading engineering teams in cloud data projects
- Familiarity with advanced data governance and data quality frameworks in MDM environments
- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline
- AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect – Professional
- Certification in Apache Spark or relevant big data technologies (preferred)
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- SW

Structured Data Engineer - AI Search (Remote, Full-Time) [HR226]Recently posted Auto Apply
Smart Working Solutions · India · Remote · Posted 18 Nov 2026 🇮🇳
SQLGitHTML+7TechnologySalary not listed - BM

AI Data Engineer (Speech & Language)Recently posted Auto Apply
Blue Machines AI · Bengaluru, Karnataka · On-site · Posted 19 Nov 2026 🇮🇳
GitNLPBash+6TechnologySalary not listed - CA

Snowflake Data EngineerRecently posted Auto Apply
Capco · Bengaluru · Hybrid · Posted 19 Nov 2026 🇮🇳
SQLGitETL+13TechnologySalary not listed - WP

Data EngineerRecently posted Auto Apply
WPP · Chennai · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLApache SparkDatabricks+9TechnologySalary not listed - JU

Data Engineer - II (Biometrics)Recently posted Auto Apply
Jumio · Bengaluru · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLAWSETL+5TechnologySalary not listed - CH

Senior Data EngineerRecently posted Auto Apply
Cohere Health · Hyderabad · Hybrid · Posted 17 Nov 2026 🇮🇳
SQLApache SparkAWS+6TechnologySalary not listed - B2
Senior Fabric Lead Data Engineer - R01572945 Auto Apply
Brillio 2 · Bengaluru · Hybrid · Posted 22 Oct 2026 🇮🇳
SQLGitApache Spark+6TechnologySalary not listed - WE
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekdayworks · Bengaluru · On-site · Posted 16 Nov 2026 🇮🇳
Technology₹1400k - ₹2000k/yr - V1
Senior Oracle Fusion Data Migration ConsultantRecently posted Auto Apply
Version 1 · Bengaluru, KA · Hybrid · Posted 16 Nov 2026 🇮🇳
OraclePL/SQLSQL+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Chennai, Tamil Nadu · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Hyderabad, Telangana · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Pune, Maharashtra · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed