Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
United States
Posted
8 hours ago
Unity
Job Description
Over 8 Years of experience in IT.
- Design and implement end-to-end lifecycle of Databricks platform on AWS.
- Design and implement different environments like Dev/SIT/UAT/PROD for Databricks.
- Expertise in AWS
- Implement data access controls, Lineage and auditing using Unity catalog.
- Implement CI/CD pipelines between different environments.
- Hands-on architecture experience within AWS, Azure, or Google Cloud Platform environments.
- Deep expertise in Apache Spark, Delta Lake, SQL, and cluster resource management.
- Translate business requirements into technical blueprints, run proof-of-concepts (POCs), and guide engineering teams on best practices
- AI/ML Enablement, experience in setting up AI and Genie for Databricks.
- Experience with Delta lake house, Unity catalog, DBX notebooks, Python, Pyspark, Genie, Databricks Apps.
Thanks and Regards,
Aju
Shakti Group Inc
Phone:
Email:
Fax:
Similar jobs
- VI
Data Engineer - Sr. Consultant level
NewVisa
Foster City, California🇺🇸$180.6k - $289.3k/yrHybrid16 minutes agoSQLScalaMachine Learning+8Technology - LE
Principal Data Engineer
NewLeidos
Bethesda, Maryland🇺🇸$131.3k - $237.3k/yrHybrid1 hour agoOracleSQLAWS+5Technology - BA
Data Engineer, Senior with Security Clearance
NewBooz Allen Hamilton
Quantico, VA🇺🇸$77.6k - $176k/yrOn-siteYesterdayMongoDBSQLScala+16Technology - BA
Data Engineer with Security Clearance
NewBogart Associates
Washington, DC🇺🇸RemoteYesterdaySAFeGCPSQL+20Technology - FV
Subject Matter Expert Data Engineer with Security Clearance
NewFull Visibility LLC
Huntsville, AL🇺🇸$179k - $201k/yrHybridYesterdayScalaAWSNLP+3Technology - AG
Data Engineer CO-OP - PE
NewAudax Group
Boston🇺🇸Hybrid12 hours agoSQLETLJava+3Technology