Azure Databricks Architect-Raritan, NJ

Databricks ADF Azure ADLS Gen2 Pyspark Java SQL Query writing Python Scala knowledge of system integration using API and Drivers

Good communication skills

Ability to work at client site in hybrid

Experience with UC delta share and UC catalogues

Implemented ALMLOps

Job Duties

Write and manage notebooks in Databricks

Implementing new data analytics requirement using ADLS Gen2 Pyspark Python Scala and SQL

Job monitoring problem solving of iris service now tickets

Code enhancement and Change Request handling

Code Migration related CICD activities

Skills

Mandatory Skills : AWS Glue, AWS S3, AWS SageMaker