Data Engineer V

Job Title: Principal Data Compliance Engineer (Utility Infrastructure)

Role Overview
We are seeking a high-level Principal Data Compliance Engineer to lead the development of mission-critical, auditable data pipelines supporting state and federal regulatory reporting. In this role, you will be responsible for building robust data validation frameworks and ensuring that large-scale datasets meet strict compliance standards for reproducibility and lineage. You will act as a bridge between technical engineering and regulatory subject matter experts, creating the "Gold Standard" for traceable data outputs in a highly scrutinized utility environment.

Key Responsibilities
Pipeline Architecture: Design and maintain advanced, platform-native data pipelines specifically for regulatory compliance reporting.
Validation Frameworks: Build and oversee automated data checker and validation frameworks to ensure completeness, consistency, and reconciliation across large-scale datasets.
Advanced Transformations: Develop high-performance transformations using PySpark and Spark SQL to process and curate complex infrastructure and asset-based data.
Audit & Traceability: Implement rigorous data lineage and reproducibility protocols to ensure all outputs are "audit-ready" and meet government regulatory standards.
Logic Validation: Partner with Compliance SMEs and stakeholders to translate complex legal and safety requirements into precise technical validation logic.
Operational Integrity: Lead operational monitoring, issue triage, and data quality remediation to maintain the integrity of compliance datasets.

Qualifications & Requirements
Technical Mastery:
Expert-level Python, PySpark, and Spark SQL.
Hands-on experience with enterprise-grade data platforms (e.g., Palantir Foundry or similar high-lineage environments).
Proven track record building Data Quality (DQ), QA, or automated validation frameworks.
Industry Knowledge:
Deep understanding of compliance, audit, or regulatory reporting requirements.
Experience with Ontology-driven or curated datasets.
Attributes: Strong analytical mindset with the ability to ensure full data reconciliation and exception flag management in a high-stakes environment.

Preferred Credentials
Prior experience with utility-specific regulatory compliance (e.g., OEIS or similar safety infrastructure reporting).
Experience with specialized platform application builders (e.g., Foundry Workshop).
Background in asset-based domains or utility infrastructure. Equal Opportunity Employer / Disabled / Protected Veterans

The Know Your Rights poster is available here:
_EEOC_KnowYourRights6.12.pdf

The pay transparency policy is available here:
_%20English_formattedESQA508c.pdf

For temporary assignments lasting 13 weeks or longer, AllSTEM Connections is pleased to offer major medical, dental, vision, 401k and any statutory sick pay where required.

We are committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation for any part of the employment process, please contact your staffing representative who will reach out to our HR team.

AllSTEM Connections participates in the E-Verify program in certain locations as required by law. Learn more about the E-Verify program.
_Participation_Poster_ES.pdf

We also consider for employment qualified applicants regardless of criminal histories, consistent with legal requirements, including, if applicable, the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance. Pursuant to applicable state and municipal Fair Chance Laws and Ordinances, we will consider for employment-qualified applicants with arrest and conviction records, including, if applicable, the San Francisco Fair Chance Ordinance. For Los Angeles, CA applicants: Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.

Additional Skills

(none specified)

AllSTEM Representative Contact Info

Account Executive:

Nichols

Branch Phone:



Location:

Ontario, CA