Data Engineer
Why This Role Stands Out
This on-site Data Engineer role offers significant opportunities to refine critical data pipelines and build robust data solutions, perfect for a mid-senior professional eager to enhance their skills with a reputable firm. You'll thrive by leveraging your expertise in data optimization and pipeline development to create impactful analytical datasets. Apply now to contribute to innovative projects and advance your career.
Quick Overview
Job Description
Job Type: -Contract
Please share only qualified local/nearby profiles that meet the onsite requirement and work authorization criteria.
Key responsibilities for the Data Engineer:
- Optimize data pipelines that read from Kinesis and Write into Oracle improve exception handling for schema/data type mismatches and implement alerting for data quality issues.
- Build services to read/write data to NetApp object store using the S3 API.
- Create analytical datasets in Parquet or Iceberg format.
- Develop housekeeping scripts for cleanup, archiving, and compression of logs, Object store files, etc.
Core skill requirements:
- Strong Python/Java and data engineering expertise.
- Experience building and deploying data pipelines using frameworks like Spark, Flink and understanding of distributed data systems.
- Hands-on experience with real-time streaming architectures, REST APIs, and database connectors.
- Proficient with and Relational Databases (e.g. Oracle).
- Experience working with Amazon S3 APIs for data storage and integration.
Preferred (nice-to-have):
- Experience with Apache Iceberg.
- GraphQL
Skills
Similar jobs
Power BI and Data engineer
Neumeric Technologies Corporation · Raleigh, United States
1 hour agoIT Specialist (Data Engineer)
U.S. Railroad Retirement Board · Chicago, United States
1 hour ago$90.9k - $118.2k/yrData Engineer (Databricks, AWS)
Computer Enterprises, Inc. · Almont, United States
1 hour ago€85/hrSenior Databricks Data Engineer
Conquest Consulting · Austin, United States
1 hour agoAzure Data Engineer with DBT and Python
Alltech Consulting Services, Inc. · New York, United States
1 hour agoData Engineer
Learn Beyond Consulting LLC · United States
1 hour ago