Back to Jobs
Recently postedTechnology

Lead Data Engineer

Rapsys TechnologiesColumbus, OH🇺🇸United States

Quick overview

Work modeHybrid
LocationColumbus, OH, United States
Apache SparkAWSETLSnowflakeAirflowApacheJavaKafkaPythonDelta Lake

Job description

Job Description:

We are looking for a Lead Data Engineer with strong experience in enterprise data engineering, distributed processing, and cloud-based data platforms.

The candidate should have hands-on experience designing and developing scalable data pipelines and data lake/lakehouse solutions.

Key Responsibilities:

Design and develop scalable data engineering solutions.

Build and maintain ETL/ELT pipelines.

Work with large-scale data processing using Apache Spark.

Develop data solutions using Java and Python.

Build and support AWS-based data platforms.

Work with data lakes and lakehouse architectures.

Implement data quality, validation, and governance practices.

Optimize data processing and pipeline performance.

Collaborate with architecture and engineering teams.

Support production data engineering environments.

Required Skills:

10+ years of relevant experience.

Strong Java programming.

Python.

Apache Spark.

AWS.

ETL/ELT development.

Data lake and lakehouse concepts.

Parquet and Avro data formats.

Data quality and governance.

Preferred Skills:

Airflow, Dagster, or Control-M.

Kafka and streaming technologies.

Delta Lake, Apache Iceberg, or Hudi.

Snowflake.

Will your resume get past this employer's screening? Check your resume against this job, free

Similar jobs