Back to Jobs
Recently postedOther

Databricks Architect

SumasEdge CorporationHouston, TX🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeHybrid
LocationHouston, TX, United States
SQLApache SparkAWSETLNumPyData PipelineDatabricksPandasPythonSAPAzure

Job description

Job Summary:

Overall 10 + Years of experience and 3+ years of experience Developing, deploying data solutions using AWS/Azure Data Bricks in PySpark

Responsible for developing, capturing, and sharing solution architecture patterns, and best-practices knowledge that can be applied across domains.

Work with Business stakeholders and users to assist design, develop and deliver their data models or self-service model.

Work with global Data Standards, structures, and processes to maintain global guidelines

Experience with AWS Ecosystem and AWS S3

Ability to work on multiple areas like Data pipeline ETL, Data modelling & design, writing complex SQL queries etc.

Hands-on expert with real-time data processing and analytics, data ingestion (batched and streamed), and data storage solutions

Hands on knowledge on Python along its main data libraries like Pandas, Numpy, Beautiful soup etc

Demonstrated strength in data management, orchestration, access control, etc.

A proven expert in writing optimized SQL to deal with large data volumes

Desirable to have knowledge on SAP ECC

Key Responsibilities:   

Work with Business stakeholders and users to assist design, develop and deliver their data models or self-service model.

Work with global Data Standards, structures, and processes to maintain global guidelines

Experience with AWS Ecosystem and AWS S3

Ability to work on multiple areas like Data pipeline ETL, Data modelling & design, writing complex SQL queries etc.

Hands-on expert with real-time data processing and analytics, data ingestion (batched and

streamed), and data storage solutions

Hands on knowledge on Python along its main data libraries like Pandas, Numpy, Beautiful soup etc

Demonstrated strength in data management, orchestration, access control, etc.

Required Skills:  

Databricks

Preferred Qualifications:     

the required qualification is primarily a combination of Databricks data engineering, SQL, Python, Azure data services, and foundational architecture skills.

Similar jobs