Databricks Engineer

Over 8 Years of experience in IT.

1. 1. Design and implement end-to-end lifecycle of Databricks platform on AWS.
   2. Design and implement different environments like Dev/SIT/UAT/PROD for Databricks.
   3. Expertise in AWS
   4. Implement data access controls, Lineage and auditing using Unity catalog.
   5. Implement CI/CD pipelines between different environments.
   6. Hands-on architecture experience within AWS, Azure, or Google Cloud Platform environments.
   7. Deep expertise in Apache Spark, Delta Lake, SQL, and cluster resource management.
   8. Translate business requirements into technical blueprints, run proof-of-concepts (POCs), and guide engineering teams on best practices
   9. AI/ML Enablement, experience in setting up AI and Genie for Databricks.
   10. Experience with Delta lake house, Unity catalog, DBX notebooks, Python, Pyspark, Genie, Databricks Apps.