Quick Overview
Job Description
Key Responsibilities
Design, develop, test, and deploy scalable ETL/ELT pipelines for high-volume, multi-source data environments. Build reusable data connectors and integration services to ingest data from APIs, databases, files, and other enterprise data sources. Develop and integrate RESTful APIs and data services to support data ingestion, retrieval, transformation, and downstream applications. Design data transformation and normalization processes for structured and unstructured data.
Implement data quality controls, including validation, reconciliation, deduplication, error handling, and exception management. Develop automated processes for data lineage, metadata capture, logging, monitoring, and auditability. Design and optimize data models, schemas, and storage solutions using relational and other appropriate data technologies. Develop efficient SQL queries, stored procedures, transformations, and data-processing logic for large datasets. Build and maintain automated CI/CD pipelines for data engineering components and applications.
Required Qualifications
7+ years of experience in data engineering, data integration, or a related software engineering discipline. Demonstrated experience building and maintaining production-grade data pipelines in enterprise environments. Strong experience with ETL/ELT architecture, data transformation, orchestration, validation, reconciliation, lineage, logging, and monitoring. Advanced proficiency with SQL and relational databases. Strong programming experience in Python
Experience developing and integrating REST APIs and other data integration interfaces.
Experience working with relational databases and data-storage technologies, such as PostgreSQL or Microsoft SQL Server. Experience with Linux-based development or deployment environments. Experience with Git-based source control and CI/CD practices. Experience developing automated tests for data pipelines, APIs, or software components. Strong communication, documentation, problem-solving, and cross-functional collaboration skills.
Similar jobs
- ME
Enterprise Data Governance Consultant
NewMorph Enterprise LLC
Nashville, TN🇺🇸Hybrid23 hours agoComplianceContinuous ImprovementHIPAA - DV
Data Engineer (Onsite) :: Plano, TX or San Antonio, TX
NewDMS Vision Inc.
Plano, TX🇺🇸On-site23 hours agoSQLSnowflakePython+1Technology - MT
Databricks Data Engineer (W2 Role)
NewMicrogreen Technologies LLC
Charlotte, NC🇺🇸On-site23 hours agoSQLScalaETL+8Technology - BH
Snowflake Data Engineer
NewBeacon Hill
United States🇺🇸Remote23 hours agoSQLSnowflakeTechnology - CS
Sr. Data Engineer
NewCompest Solutions Inc
Detroit, MI🇺🇸On-site23 hours agoSQLAWSETL+8Technology - IR
Enterprise Data Governance Consultant
NewIndus River Technologies Inc.
Nashville, TN🇺🇸Hybrid23 hours agoComplianceHIPAAPMP+1