Quick overview
Job description
This position requires a hands-on developer who can build new ETL solutions if necessary, thoroughly understand all existing on-premises ETL jobs, and serve as an expert to guide the team. Key responsibilities include job execution, data validation, ensuring data quality, and adherence to data compliance and business rules. The role also encompasses understanding AWS infrastructure-as-code orchestrating and validating jobs, and providing comprehensive production support. Candidates must possess technical development expertise and a strong background in data analytics
- Leverage development experience with DataStage or Informatica, Korn Shell, Python, and Perl scripting on Unix/Linux platforms.
- Be able to design, develop, and implement ETL Glue PySpark processes to extract, transform, and load data from various sources into AWS cloud-based data warehouses and data lakes, specifically Redshift and Aurora PostgreSQL.
- Be able to develop scalable and efficient full-stack applications, including both front-end and back-end components or APIs, as required.
- Conduct business analysis and perform data analysis/ validation to minimize errors and inconsistencies, extract meaningful insights, and support business decision-making throughout the software development lifecycle.
- Collaborate closely with data analysts, data architects, and other team members to analyze source data, enhance data accuracy and integrity, implement data reporting, and understand data and application requirements to deliver effective solutions.
- Automate and orchestrate ETL processes, applications, and APIs to optimize performance and scalability across cloud environments.
- Proactively provide production support, including monitoring, troubleshooting, and resolving issues for ETL processes, configurations, and data integrity.
- Develop comprehensive documentation covering overall processes, data mappings, data flows, APIs, application code, and support procedures.
- Perform impact analysis and effectively communicate technical processes and concepts to larger audiences.
- Ensure data and application security and compliance with all relevant data protection regulations.
- Participate in code reviews, adhere to best practices, and provide constructive feedback to peers.
- Stay up to date with the latest industry trends and best practices in the areas of ETL development, full-stack development, data analysis, and cloud technologies.
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- More than 8 years of experience in ETL development, data warehousing, AWS cloud services, and API development.
- Comprehensive proficiency in all AWS services with a strong understanding of data integration, transformation, and loading processes.
- Expertise in scripting languages, including DataStage or Informatica, Shell scripting, Perl, and Python.
- Experience with API development and frameworks such as REST and SOAP.
- Advanced skills utilizing the AWS cloud platform and services, including AWS Glue, Step Functions, Airflow DAGS, Lambda, S3, EC2, and others.
- Proficiency in SQL with both on-premises relational databases (such as DB2 on AIX) and AWS databases (such as Amazon RDS, Amazon Aurora PostgreSQL, and Redshift).
- Experience with version control tools like Git or Bitbucket.
- Familiarity with implementing Jenkins pipelines and CI/CD processes.
- Demonstrated experience in data analysis/ validation, utilizing tools such as Excel, Python, and Tableau.
- AWS certifications and expertise in AI/ML are advantageous.
- Familiarity with automotive industry knowledge, data warehousing concepts, and adherence to developer best practices.
Experience working within Agile development methodologies
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- PE

Senior Software Engineer (Mainframe, Java) Akana Sola Auto Apply
Perforce · Pune · Hybrid 🇮🇳
DockerMySQLOracle+16TechnologySalary not listed - WA

Software Development TraineeRecently posted Auto Apply
Wabtec · Bengaluru, KA · On-site · Posted 17 Nov 2026 🇮🇳
RustSQLGit+3TechnologySalary not listed - LI
Staff Software Engineer - Enterprise PlatformRecently posted Auto Apply
LinkedIn · Bengaluru, KA · Hybrid · Posted 17 Nov 2026 🇮🇳
JavaC++MySQL+3TechnologySalary not listed - NE
Senior Software Engineer - MuleSoft with AWSRecently posted Auto Apply
NECSWS · Bengaluru, KA · Hybrid · Posted 17 Nov 2026 🇮🇳
Stakeholder ManagementAWSAPI Gateway+10TechnologySalary not listed - IX
Senior Software Engineer - AndroidRecently posted Auto Apply
ixigo · Gurugram · On-site · Posted 17 Nov 2026 🇮🇳
Generative AITechnologySalary not listed - SS
MS SharePoint Senior Software EngineerRecently posted Auto Apply
Sopra Steria · Noida, Uttar Pradesh · On-site · Posted 17 Nov 2026 🇮🇳
SQLMicrosoft OfficeAzure+4TechnologySalary not listed - NI
Software EngineerRecently posted Auto Apply
NielsenIQ · Chennai, TN · Hybrid · Posted 17 Nov 2026 🇮🇳
ScrumConfluenceContinuous Improvement+3TechnologySalary not listed - PH

Staff Engineer - Kafka Codebase and InternalsRecently posted Auto Apply
PHONEPE LIMITED · Bengaluru, Karnataka · On-site · Posted 17 Nov 2026 🇮🇳
CockroachDBKafkaApacheTechnologySalary not listed - CO

Software Engineer IIRecently posted Auto Apply
Couchbase, Inc. · Bengaluru · Hybrid · Posted 17 Nov 2026 🇮🇳
DockerGCPGit+11TechnologySalary not listed - AD

Software Engineer - ADMRecently posted Auto Apply
Addepar · Pune · Hybrid · Posted 17 Nov 2026 🇮🇳
DynamoDBSQLAWS+5TechnologySalary not listed - 6S

Staff Software Engineer (Backend)Recently posted Auto Apply
6sense · Bengaluru · Hybrid · Posted 17 Nov 2026 🇮🇳
DjangoDockerSQL+6TechnologySalary not listed - SP

Senior Device Software EngineerRecently posted Auto Apply
Span · Bengaluru · On-site · Posted 17 Nov 2026 🇮🇳
RustC++Greenhouse+2TechnologySalary not listed