- Design, configure, and manage the Databricks platform, including workspace setup, cluster administration, job orchestration, and platform optimization.
- Establish platform standards, best practices, and reusable frameworks to support enterprise-scale data engineering and analytics workloads.
- Enable development teams through CI/CD automation, deployment standards, technical guidance, and platform support.
- Implement and manage security, governance, access controls, and Unity Catalog to ensure compliance with enterprise standards.
- Integrate Databricks with cloud environments, data lakes, BI tools, orchestration platforms, and enterprise applications.
- Monitor platform performance, reliability, utilization, and costs while driving automation and continuous improvement initiatives.
|
Mandatory Skills | Education: - Bachelor s degree in Computer Science, Engineering, Data Science, or a related quantitative field.
Mandatory Skills - 5+ years of experience in Data Engineering, Platform Engineering, or Data Platform Administration.
- 3+ years of hands-on experience with Databricks administration, platform engineering, or architecture.
- Strong experience with Apache Spark, distributed data processing, and workload optimization.
- Experience with Azure Databricks and cloud platforms such as Azure, AWS, or Google Cloud Platform.
- Hands-on experience with Unity Catalog, RBAC, security, governance, and access management frameworks.
- Experience with CI/CD pipelines, Infrastructure as Code (Terraform), automation, and DevOps practices.
Preferred Skills - Experience with Delta Lake, Lakehouse Architecture, and modern enterprise data platforms.
- Knowledge of streaming and real-time data processing frameworks such as Structured Streaming, Kafka, or Event Hubs.
- Databricks and cloud platform certifications (Databricks Certified Professional, Azure Data Engineer, or Azure Solutions Architect) and experience supporting large-scale enterprise data platforms.
Nice-to-Have Skills - Experience with Delta Lake, Lakehouse architecture, and modern data platform implementations.
- Knowledge of streaming frameworks such as Structured Streaming or Kafka.
- Databricks, Azure, or cloud platform certifications
|
