Data Engineer

MUST-HAVE SKILLS

• Strong hands-on Data Engineering and datastore migration experience.

• Experience migrating on-prem Data Lakes to AWS-hosted LakeHouse environments.

• Strong Python or Java programming and advanced SQL troubleshooting.

• Experience with Apache Spark, Snowflake, and Apache Iceberg.

• Data pipeline migration, job scheduling, and SQL/Spark code conversion.

• Data reconciliation, validation, and data quality assurance.

• Strong data modeling: SCD Type 2, schema evolution, partitioning, and clustering.

• Experience with CI/CD, SDLC, and Kubernetes (K8s).

• Familiarity with Kafka, Hadoop/HDFS, Hive, JSON, Avro, Parquet, FTP, and Sybase IQ.

• Strong stakeholder communication, ownership, and cross-team collaboration.