Why this role stands out
Shape the future of data products in a remote environment where you'll leverage your expertise in Databricks and Azure to design and implement robust data supply chains. This role offers significant opportunities to refine your skills in data pipeline optimization and CI/CD implementation while collaborating with a dynamic team. Apply now to make a tangible impact on enterprise data solutions.
Quick overview
Job description
The client is seeking a strong Data Architect to be part of their data product development team. It consists of data engineers who can assist in translating business requirements into data products. Create efficient, reusable data pipelines; work with product owners and stakeholders to design, develop, and implement data supply chains in enterprise data warehouse environments using Microsoft Azure, ADF, Python, Pyspark, Spark SQL and Databricks.
Responsibilities::
- Ensure data quality, reliability, orchestration of data pipelines, CI/CD implementation, and performance/optimization of data pipelines for efficiency, while collaborating with cross-functional teams to integrate data sources and optimize pipelines.
- Also, this engineer must provide technical expertise and support for Azure Databricks-related projects.
- Follow technical best practices and coding standards, job orchestration & monitoring, and produce mandatory artifacts.
Requirements:
- Bachelor's degree in computer science, information technology, or a related field.
- Prior experience with data lakes and data warehouses, working knowledge of dimensional modeling is a must.
- Demonstrate an advanced understanding of data engineering practices, including ETL/ELT, data integrations, reusable data pipelines, and data management methods.
- Advanced skills required in Pyspark, Python, Spark SQL, Dimensional models, optimization in Azure, and Databricks.
- Ability to service various business stakeholders, internal and external partners to support data demands.
- Healthcare experience with a data-centric motive is a plus.
- 8+ years of experience in data engineering with the Azure Databricks ecosystem.
- Strong knowledge of Azure data services, including ADF, Databricks, Delta Lake, delta live tables, Power BI, and Azure SQL Server
- Experience with data processing languages such as SQL, Python, Pyspark and Spark SQL
- Experience with agile methodologies on Azure DevOps and continuous integration/continuous delivery (CI/CD)
- Strong problem-solving and analytical skills; excellent communication and collaboration skills
- Self-motivated and a self-starter with strong ability to multitask projects/tasks effectively.
- Ability to work independently and collaborate effectively in a team environment.
Similar jobs
- SB
Senior Director, Data and AI
Staples Business · Framingham · On-site 🇺🇸
Contract NegotiationMental HealthPerformance Management+3Salary not listed - EG

Data ArchitectRecently posted
Enexus Global · New York, NY · Hybrid 🇺🇸
SQLSnowflakeHadoop+4TechnologySalary not listed - ST

Data ArchitectRecently posted
Stefanini · Dearborn, MI · On-site 🇺🇸
MongoDBBigQuery.NET+3TechnologySalary not listed - ST
Data Architect & ModelerRecently posted
SR Talent Solution Inc · Orlando, FL · Hybrid 🇺🇸
OracleSQLApache Spark+1TechnologySalary not listed - DC

Data ArchitectRecently posted
Dechen Consulting Group · United States · Remote 🇺🇸
.NETGoogle CloudPostgreSQL+1TechnologySalary not listed - VA

Data ArchitectRecently posted
Vastika Inc. · Exton, PA · On-site 🇺🇸
SQLAWSETL+7TechnologySalary not listed - HG

Data Architect Enterprise Data & GovernanceRecently posted
HTC Global Services · Dearborn, MI · Hybrid 🇺🇸
MongoDBBigQuery.NET+3TechnologySalary not listed - AT
Data ArchitectRecently posted
Arbor Tek Systems · Winchester, TN · On-site 🇺🇸
OraclePL/SQLSQL+6TechnologySalary not listed - AG

Data Integration ArchitectRecently posted
ASCII Group LLC · Houston, TX · Hybrid 🇺🇸
OracleAWSETL+7Technology$92/hr - PT
Data ArchitectRecently posted
Pinnacle Technical Resources · Delaware · Hybrid 🇺🇸
SQLGoogle WorkspaceAWS+5Technology$80 - $85/hr - BF
Senior Data Architect / Lead Oracle DeveloperRecently posted
BC Forward · Addison, Texas · On-site 🇺🇸
OracleSQLETL+8Technology$68/hr - CC

Director - Data Strategy, Enterprise Reporting and ImplementationRecently posted Auto Apply
Crosscountry Consulting · United States · Remote 🇺🇸
CompliancePerformance ManagementBusiness DevelopmentSalary not listed
