Quick overview
Job description
Responsibilities and duties:
Data Engineering
- Build and maintain ETL/ELT pipelines for structured and unstructured data sources.
- Develop data-processing workloads using Azure Databricks, Python/PySpark, and SQL.
- Optimize Databricks jobs, compute, and data layouts for performance and cost.
- Work with Delta Lake and Unity Catalog for data storage, governance, and access control.
- Implement data quality checks, monitoring, error handling, and recovery mechanisms.
Cloud & Platform Engineering
- Build, operate, and optimize Azure services including App Service, Functions, Blob/ADLS storage, Azure SQL DB for Postgres, Key Vault, Container Registry, and Azure Monitor.
- Experience with cloud AI services, including vector search and embedding pipelines.
- Improve platform performance, scalability, reliability, security, and cost efficiency.
- Implement secure identity and access management using Azure managed identities, Key Vault, and secrets managed via scopes.
- Support development, staging, and production environments.
Automation & Operations
- Improve platform observability through logging, monitoring, dashboards, and alerting.
- Automate infrastructure and deployments using Infrastructure as Code (IaC) and CI/CD.
- Troubleshoot issues across cloud services, storage, databases, networking, and data pipelines.
- Support production incidents and root-cause analysis.
- Collaborate with application, AI/ML, and data engineering teams.
Requirements:
- 5+ years of experience in data engineering, cloud engineering, or a related role.
- Hands-on experience with Microsoft Azure, Databricks, APIs, and object storage.
- Strong skills in Python/PySpark and SQL.
- Experience building and operating production data ETL/ELT pipelines.
- Experience with relational and semi-structured/unstructured data and database technologies.
- Experience with Spark, Delta Lake, and lakehouse architectures.
- Working knowledge of Databricks Unity Catalog and data-access controls.
- Understanding of cloud security concepts such as RBAC, managed identities, service principals, and Key Vault.
- Experience with Git, CI/CD, monitoring, troubleshooting, and performance optimization.
Nice to Have:
- Experience with Terraform or ARM templates.
- Experience with Azure DevOps or GitHub Actions.
- Familiarity with Azure networking, including VNets and private endpoints.
- Experience with Azure Data Factory, Databricks Workflows, or Airflow.
- Familiarity with data platforms supporting AI/ML, NLP, analytics, or GenAI applications.
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- II

Senior Data Engineer / Software Engineer (SQL, Databricks, Java, Spark)Recently posted
Intuitive Insights LLC · Houston, TX · On-site · Posted 19 Nov 2026 🇺🇸
DockerOraclePL/SQL+18TechnologySalary not listed - GT
Senior Data Engineer with AIRecently posted
Goldenpick Technologies LLC · Dallas, TX · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerNeo4jSQL+23TechnologySalary not listed - SS

Data Engineer with Autosys & StonebranchRecently posted
Softcom Systems · Weehawken Township, NJ · Hybrid · Posted 19 Nov 2026 🇺🇸
ShellETLNumPy+5TechnologySalary not listed - LO
Data Engineer – Cloud Security (AWS)Recently posted
Logicplanet, Inc. · Milpitas, CA · On-site · Posted 19 Nov 2026 🇺🇸
AWSEncryptionCDK+4TechnologySalary not listed - AM

Data Engineer Lead - W2Recently posted
Ampcus Inc · Columbus, OH · Hybrid · Posted 19 Nov 2026 🇺🇸
Apache SparkETLSnowflake+9TechnologySalary not listed - RD

Data Engineer (EDA)Recently posted
Randstad Digital · Irving, TX · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLETLSnowflake+1Technology$69 - $70/hr - FL
Senior PostgreSQL DBARecently posted
Flexton Inc · Los Angeles, CA · Remote · Posted 19 Nov 2026 🇺🇸
MySQLOracleSQL+25TechnologySalary not listed - PS

Senior Snowflake Data Engineer (Informatica) Remote (Local)Recently posted
Paramount Software Solutions, Inc · Denver, CO · Remote · Posted 19 Nov 2026 🇺🇸
SQLGitETL+6TechnologySalary not listed - GA

Staff Data EngineerRecently posted Auto Apply
Gamechanger · GameChanger Remote - US · Remote · Posted 18 Nov 2026 🇺🇸
SQLAWSMLOps+8Technology$170k - $185k/yr - SP

Snowflake & Informatica Data EngineerRecently posted
Stellar Professionals LLC · United States · On-site · Posted 19 Nov 2026 🇺🇸
SQLGitETL+5TechnologySalary not listed - TH

Data EngineerRecently posted
The Hollister Group · Pittsburgh, PA · On-site · Posted 19 Nov 2026 🇺🇸
SQLAWSETL+7Technology$75k - $85k/yr - VN

Data EngineerRecently posted
Virtual Networx · Boston, MA · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLETLDatabricks+4TechnologySalary not listed