Sr Engineer1 (Data Engineer Python, IBM Cloud & Databricks)

Mandatory Skills

• p]:pt-0 [&>p]:mb-2 [&>p]:my-0>

  5 7 years of experience in data engineering, ETL/ELT development, data warehousing, or cloud data platforms.

• p]:pt-0 [&>p]:mb-2 [&>p]:my-0>

  Strong hands-on expertise in Python, including pandas, requests, boto3 or equivalent SDKs, API integration, batch processing, and automation.

• p]:pt-0 [&>p]:mb-2 [&>p]:my-0>

  Strong hands-on experience with IBM Cloud, including IBM Cloud Object Storage, IBM Db2, IBM Event Streams, IBM Watson services, IBM Cloud Functions, or equivalent IBM Cloud data services.

• p]:pt-0 [&>p]:mb-2 [&>p]:my-0>

  Strong hands-on experience with Databricks, including notebooks, PySpark, Spark SQL, Delta Lake, Databricks Workflows/Jobs, Unity Catalog, cluster management, and performance optimization.

• p]:pt-0 [&>p]:mb-2 [&>p]:my-0>

  Strong SQL skills, including complex joins, CTEs, window functions, stored procedures, query optimization, and data reconciliation.

• p]:pt-0 [&>p]:mb-2 [&>p]:my-0>

  Experience designing and implementing batch and/or streaming data pipelines.

• p]:pt-0 [&>p]:mb-2 [&>p]:my-0>

  Experience with Git, CI/CD, Agile/Scrum, and production support.

• p]:pt-0 [&>p]:mb-2 [&>p]:my-0>

  Excellent communication and stakeholder-management skills.