Why this role stands out
This on-site Data Engineer role offers significant opportunities to refine critical data pipelines and build robust data solutions, perfect for a mid-senior professional eager to enhance their skills with a reputable firm. You'll thrive by leveraging your expertise in data optimization and pipeline development to create impactful analytical datasets. Apply now to contribute to innovative projects and advance your career.
Quick overview
Job description
Data Engineer
Location: Charlotte, NC
Face to Face Interview
Key responsibilities for the Data Engineer:
- Optimize data pipelines that read from Kinesis and Write into Oracle improve exception handling for schema/data type mismatches and implement alerting for data quality issues.
- Build services to read/write data to NetApp object store using the S3 API.
- Create analytical datasets in Parquet or Iceberg format.
- Develop housekeeping scripts for cleanup, archiving, and compression of logs, Object store files, etc.
Core skill requirements:
- Strong Python/Java and data engineering expertise.
- Experience building and deploying data pipelines using frameworks like Spark, Flink and understanding of distributed data systems.
- Hands-on experience with real-time streaming architectures, REST APIs, and database connectors.
- Proficient with and Relational Databases (e.g. Oracle).
- Experience working with Amazon S3 APIs for data storage and integration.
Similar jobs
- CS

Senior Data Engineer - Remote / TelecommuteNew
Cynet Systems · Hartford, CT · Remote 🇺🇸
Apache SparkAWSSOC 2+6TechnologySalary not listed18 hours ago - ST
Data EngineerNew
Symbioun Technologies, Inc · Raleigh, NC · Hybrid 🇺🇸
SQLApache SparkDatabricks+3TechnologySalary not listed18 hours ago - AT

Forward Deployed Engineer — Data Engineering & GenAINew
Aivanta Tech Inc · Washington, DC · Hybrid 🇺🇸
AWSETLSnowflake+14TechnologySalary not listed18 hours ago - CU
Azure Data EngineerNew
CSG US GROUP INC · Greenfield, IN · On-site 🇺🇸
SQLGitApache Spark+8TechnologySalary not listed18 hours ago - DI

Data Integration EngineerNew
Della Infotech · Sunnyvale, CA · Hybrid 🇺🇸
SQLShellAWS+10TechnologySalary not listed18 hours ago - MU

Databricks EngineerNew
MphasiS Corporation USA · Columbus, OH · On-site 🇺🇸
AgileEngineeringSalary not listed18 hours ago - UO

Data Engineer LeadNew
University of Michigan · Ann Arbor, MI · Remote 🇺🇸
Stakeholder ManagementSnowflakeDatabricks+3Technology$115k - $125k/yr18 hours ago - PT
Hiring for HEDIS - Data Engineer :: RemoteNew
PropelSys Technologies LLC. · AK · Remote 🇺🇸
SQLScalaETL+8TechnologySalary not listed18 hours ago - KT

Data Engineer - BI & AnalyticsNew
Kforce Technology Staffing · Dallas, TX · Hybrid 🇺🇸
SQLApache SparkDatabricks+2TechnologySalary not listed18 hours ago - AL

Vertica and Pentaho Migration SpecialistNew Auto Apply
Allwyn Corp · Allwyn US- Remote · Remote 🇺🇸
ETLReconciliationSalary not listed12 hours ago - PT
Principal Data EngineerNew
Pyramid Technology Solutions, Inc. · United States · Hybrid 🇺🇸
DatabricksPythonAzureTechnologySalary not listed18 hours ago - AA
DATA ENGINEERNew
AaraTechnologies Inc · Washington, DC · Hybrid 🇺🇸
SQLAWSETL+2TechnologySalary not listed18 hours ago