Sr Data Engineer

Introduction:

The Sr Data Engineer will be responsible for managing and optimizing data pipelines, ensuring data quality, and collaborating with various teams to deliver curated datasets for AI/ML projects. The role involves working with a variety of systems such as Salesforce, Dynamics, Workday, and Concur to extract, transform, and load data efficiently.

Responsibilities:

1. Ingest and process data from Salesforce (Investments), Dynamics 365, Coupa (Finance), Workday (HR), Concur (Operations), and external program/partner data.
2. Build and maintain pipelines in Databricks, DBT, and Snowflake to deliver curated datasets for AI/ML.
3. Design simple, reusable data models to support training and inference.
4. Implement data quality tests, documentation, and lineage in DBT.
5. Ensure performance optimization, cost efficiency, and compliance with governance standards.
6. Collaborate with the Knowledge Management (AI/Data Science) team to provide feature-ready datasets.

Requirements:

Required Skills:

• Snowflake
• Databricks
• DBT
• ETL/ELT pipeline development
• Enterprise SaaS systems experience (Salesforce, D365, Coupa, Workday, Concur)
• Strong SQL and Python skills
• Data quality frameworks knowledge

Preferred Skills:

• Artificial Intelligence
• Machine Learning (ML)
• Performance Tuning
• SQL Tuning
• Training
• Knowledge Management
• PySpark
• Collaboration
• Documentation
• Finance
• Regulatory Compliance
• Unity
• Workday