Quick Overview
Seniority
Mid Senior
Work mode
On Site
Location
Hyderabad, Telangana, India
Posted
2 months ago
GCPSQLScalaAWSETLMLOpsMLflowSplunkAzureDatabricksGitLLMPrometheusPythonTerraformUnity
Job Description
- Design and implement scalable data pipelines using Delta Live Tables (DLT), Spark SQL, Python, or Scala.
- Optimize ETL, streaming, and ML workloads for performance, cost efficiency, and reliability.
- Administer and configure Databricks Workspaces, Unity Catalog, and cluster policies for secure, governed environments.
- Automate infrastructure and deployments using Terraform, Git, and CI/CD pipelines.
- Implement observability, cost optimization, and monitoring frameworks using tools like Splunk, Prometheus, or CloudWatch.
- Collaborate with customers to build AI and LLM solutions leveraging MLflow, DBRX, and Mosaic AI.
- Strong hands-on experience with Databricks, including workspace setup, notebooks, clusters, and job orchestration.
- Expertise in Delta Lake, DLT, Unity Catalog, and SQL Warehouses.
- Proficiency in Python or Scala for data engineering and ML workflows.
- Strong understanding of AWS, Azure, or GCP cloud ecosystems.
- Experience with Terraform automation, DevOps, and MLOps practices.
- Familiarity with monitoring and governance frameworks for large-scale data platforms.
Similar jobs
- NE
ServiceNow Solution Architect - Agentic AI
NewNewRocket
India🇮🇳RemoteYesterdaySOAPETLMachine Learning+5Technology - WO
Customer Centric Engineer (EMEA Market)
NewWorkato
Hyderabad🇮🇳YesterdayRubyJavaKafka+6Engineering - ZU
Sr. Solutions Architect - Workday
Zuora
Bengaluru🇮🇳1 week agoMicroservicesSQLEncryption+17Technology - ZU
Sr. Solutions Architect - Workday
Zuora
Chennai🇮🇳1 week agoMicroservicesSQLEncryption+17Technology - WI
Sr. Partner Solutions Architect - India
Wiz, Inc.
India🇮🇳Remote2 weeks agoGCPAWSAzureTechnology - WI
Solutions Engineer - West Inida
Wiz, Inc.
Mumbai🇮🇳4 weeks agoGCPAWSAzureTechnology
