Start searching
Back to Jobs
Recently postedTechnology

Data Engineer

Key Business Solutions, Inc.Dallas, TX🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeOn Site
LocationDallas, TX, United States
SQLApache SparkDatabricksPythonAzureAzure DevOpsAzure Data FactoryDelta Lake

Job description

Data Engineer

Location- any nearest Sapient office- 3 days onsite

6+ Months

USC/ HOLDER

Need min 12+ Years of exp

Responsibilities:

Create new data pipelines leveraging existing data ingestion frameworks, tools

Orchestrate data pipelines using the Azure Data Factory service.

Develop/Enhance data transformations based on the requirements to parse, transform and load data into Enterprise Data Lake, Delta Lake, Enterprise DWH (Synapse Analytics)

Perform UnitTesting, coordinate integration testing and UAT

Create HLD/DD/runbooks for the data pipelines

Configure compute, DQ Rules, Maintenance

Performance tuning/optimization

Production Support

Skills Needed:

Databricks (Data Engineering), DLT, Azure Data Factory, SQL,

PySpark, Synapse (Dedicated SQL Pool), Azure DevOps, Python, Azure Function Apps, Azure Logic Apps, Precisely (nice to have)

Similar jobs

Apply