Azure Data Engineer || Issaquah WA

The candidate will be solely responsible for building and maintaining the technical foundation of the EQE Observability Portal. This role requires specialized expertise in data engineering, ETL pipeline development, and Grafana implementation.

The EQE Observability Portal will consolidate quality and observability data from multiple systems into a single, intranet-embedded dashboard. The solution will eliminate manual reporting efforts and provide leadership and product teams with real-time visibility into quality metrics and engineering performance.

Key Responsibilities

Design, develop, and maintain ETL pipelines to ingest data from multiple enterprise tools and platforms.

Build and optimize the data warehouse architecture, including schema design and performance tuning.

Deploy and configure Grafana OSS within Azure environments.

Integrate data from REST APIs, including Octane, Azure DevOps (ADO), and SauceLabs.

Configure and manage Azure infrastructure components, including Azure AKS, Azure Active Directory, and Single Sign-On (SSO).

Develop executive and operational dashboards that provide actionable insights and real-time reporting.

Create comprehensive documentation to support ongoing operations, maintenance, and knowledge transfer.

Required Skills

Python development with strong ETL pipeline experience

Azure Data Factory (ADF) and data integration expertise

Azure SQL and PostgreSQL data modeling and database design

Grafana OSS deployment, administration, and dashboard development

REST API integration, including:

o Octane

o Azure DevOps (ADO)

o SauceLabs

Azure Kubernetes Service (AKS)

Azure Active Directory (Azure AD)

Single Sign-On (SSO) configuration and authentication management

Data warehousing and performance optimization

Project Deliverables

1. ETL Pipelines

Develop Python and/or Azure Data Factory (ADF) connectors for all five required tool APIs, enabling automated data ingestion and transformation.

2. Data Warehouse

Design, implement, and optimize the Azure SQL data warehouse schema to support reporting, analytics, and dashboard performance requirements.

3. Grafana Deployment

Deploy Grafana OSS on Azure AKS and configure Azure AD authentication with Single Sign-On (SSO) capabilities.

4. Pilot Dashboards

Develop and deliver three pilot dashboards covering:

Octane

Azure DevOps (ADO)

SauceLabs

These dashboards will provide centralized, real-time quality and observability metrics for stakeholders.

5. Documentation & Knowledge Transfer

Provide complete handoff documentation, including:

Operational runbooks

Data dictionary

Onboarding guide

Configuration and maintenance documentation