Data Engineer with Data Reliability, Quality, and Governance (W2)

Must-Have Skill: Direct exposure to data observability, data testing frameworks, or data contract tools (ideally Soda, Gable, Monte Carlo, or Great Expectations).

·  Technical Stack: Strong SQL, Python or Scala, ETL development, and experience with modern data platforms (e.g., Snowflake, Databricks, BigQuery).

Below is the JD

We are looking for a very specialized profile for a Data Engineer who has Data Contract experience preferably someone who has used/integrated Gable and/or Soda vendors.

They will work with the vendor team to test, eval, implementation and integrate them.

Responsibilities

Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure.

Builds a deep dive analytical skillset by working with higher level Data Engineers on a variety of internal and external data.

Core Responsibilities

·         Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing.

·         Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of sources for business partners to generate insight and make decisions.

·         Translates business specifications into design specifications and code. Responsible for writing programs, ad hoc queries, and reports. Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.

·         Partners with internal clients to gain a basic understanding of business functions and informational needs. Gains working knowledge in tools, technologies, and applications/databases in specific business areas and company-wide systems.

·         Participates in all phases of solution development. Explains technical considerations at related meetings, including those with business clients.

·         Tests code thoroughly for accuracy of intended purpose. Reviews end product with the client to ensure adequate understanding. Provides data analysis guidance as required.

·         Provides tool and data support to business users and fellow team members.

·         Tests and implements new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production.

·         Participates in special projects and performs other duties as assigned.

Qualifications

Minimum of three years data analytics, programming, database administration, or data management experience. Undergraduate degree or equivalent combination of training and experience.