Databricks Administration

Hello,

Greetings from iSolve Technology..!

Job title: Databricks Administration

Location: Remote

15+ years of overall IT experience with 5+ years in Databricks Administration.

Strong hands-on expertise in:

Databricks Workspace Administration

·         Unity Catalog Administration and Governance

·         RBAC, SSO, SCIM, and Security Administration

·         Cluster Administration (Interactive, Job Clusters, SQL Warehouses, Serverless)

·         Databricks Cost Management, Pricing, and FinOps Optimization

·         Platform Monitoring, Auditing, and Compliance

·         Multi-workspace Administration

·         Hive Metastore and Hive Tables Administration

·         Experience managing:

·         Catalogs, Schemas, Tables, Views, and Storage Credentials

·         Cluster Policies and Compute Governance

·         User and Access Management

·         Platform Upgrades and Runtime Management

·         Workspace Provisioning and Environment Governance

·         AWS Platform Expertise (Mandatory)

Hands-on experience administering Databricks on AWS.

Strong knowledge of:

·         AWS IAM

·         S3 Storage

·         VPC, Security Groups, and Networking

·         Secrets Management

·         Cloud Governance and Security Best Practices

·         Experience working in enterprise-scale AWS-based Data & Analytics environments.

·         Technical Understanding

Although this is not a development role, the candidate must possess a good understanding of:

·         Databricks Lakehouse Architecture

·         Apache Spark

·         Delta Lake

·         Hive Metastore and Hive Tables

·         Data Engineering workflows

·         This knowledge is required to troubleshoot platform issues, analyze job failures, perform root-cause analysis, and support engineering teams when required.

Preferred Skills

·         Experience with Hive Metastore to Unity Catalog migrations.

·         Strong understanding of Databricks pricing models and consumption optimization.

·         Exposure to Databricks Genie AI / GenAI capabilities and their governance within Unity Catalog.

·         Experience implementing enterprise security, governance, and compliance controls.

·         Databricks certifications are a plus.

Ideal Candidate Profile

·         Hands-on Databricks Administrator, not a Databricks Developer.

·         Expert in Unity Catalog, Security, RBAC, Governance, and Cost Optimization.

·         Strong experience managing clusters, SQL Warehouses, and workspace administration.

·         Deep knowledge of Hive Metastore and Hive tables.

·         Able to independently own and govern the Databricks platform on AWS.

·         Capable of troubleshooting and debugging platform and workload issues while working closely with Data Engineering, Cloud, Security, and Infrastructure teams.

·         Mandatory Skills: AWS Databricks, Unity Catalog, RBAC, Security Administration, Cluster Administration, SQL Warehouses, Cost Optimization, Platform Governance, Hive Metastore/Hive Tables, Monitoring & Compliance.