Quick Overview
Job Description
Key Responsibilities:
· Design, develop, and maintain scalable ETL/ELT pipelines using Python, PySpark, and SQL.
· Build and optimize data processing workflows using Databricks.
· Develop cloud-based data solutions using AWS S3, Lambda, CloudWatch, IAM, and SNS.
· Perform data transformation, cleansing, validation, and integration across multiple data sources.
· Implement Infrastructure as Code using Terraform and support CI/CD pipelines using Azure DevOps, Git.
· Monitor, troubleshoot, and optimize data pipelines and production environments.
· Collaborate with architects, developers, business teams, and DevOps teams to deliver scalable data solutions.
· Participate in code reviews, testing, documentation, and Agile/Scrum activities.
Candidate Must have over 10+ Years of experince and Must attend In-person Interview for the 1st Round
Similar jobs
- GO
Database Engineer
NewGovCIO
United States🇺🇸$130k - $160k/yrRemoteYesterdayOracleSQLDatabricks+2Technology - RD
Data Engineering Technical Lead
Randstad Digital
San Diego, CA🇺🇸$130k - $150k/yrHybrid2 months ago401kSQLScala+11 - RD
Data Engineering Manager
NewRandstad Digital
San Diego, CA🇺🇸$150k - $180k/yrOn-siteYesterday401kSQLSQL Server+12 - PG
Data Engineer, Onsite - 70007
NewPRIMUS Global Services Inc.
Austin, TX🇺🇸On-siteYesterdaySQLETLSnowflake+2Technology - AS
Quantitative Data Engineer (Market Data)
NewAmtex Systems Inc.
Morristown, NJ🇺🇸On-siteYesterdaySQLSQL ServerETL+2Technology - IN
FHIR Data Engineer
NewIntone Networks Inc.
United States🇺🇸HybridYesterdaySQLScalaAWS+4Technology