Information Technology – Data Engineer

JOB SUMMARY

The Data Engineer will be responsible for expanding, optimizing, and monitoring our client''s data and data pipeline architecture, as well as optimizing data flow and collection across organizational teams. The Data Engineer will support software engineers, database architects, and data analysts on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects.

This position will play a key role in developing and maintaining scalable data solutions, integrating complex healthcare data sets, and supporting the organization’s data warehousing, analytics, and business intelligence initiatives.

KEY RESPONSIBILITIES

• Create, maintain, and optimize data pipeline architecture to support next-generation products, analytics, and data initiatives.
• Design and develop scalable ETL/ELT processes for the integration and transformation of large, complex data sets.
• Develop and maintain data integration solutions using Azure Data Factory, SSIS, and other standardized data management tools.
• Integrate large, complex healthcare data sets while ensuring data quality, consistency, security, and availability.
• Design, develop, and maintain data warehouses and supporting data structures.
• Work with SQL Server, Oracle, Azure SQL, and other relational database technologies.
• Optimize data flow, data collection, and data delivery across organizational teams and technology platforms.
• Utilize Azure cloud services to develop and support scalable data engineering solutions.
• Implement and maintain source code control and development processes using Azure DevOps and Git.
• Identify and implement internal process improvements, including automation of manual processes and optimization of data delivery.
• Redesign data infrastructure and pipelines to improve scalability, performance, reliability, and maintainability.
• Build analytics tools and data solutions that leverage organizational data pipelines to provide actionable insights into member growth, operational efficiency, and other key business performance metrics.
• Collaborate with software engineers, database architects, data analysts, and business stakeholders to define data requirements and deliver effective solutions.
• Monitor data pipelines and proactively troubleshoot performance, data quality, and integration issues.
• Ensure data architecture and delivery processes remain consistent with organizational standards and ongoing technology initiatives.
• Perform other job-related duties as required.

QUALIFICATIONS

• Proficiency in data transformation, data structures, metadata management, workload management, and data warehousing.
• Strong hands-on experience with ETL/ELT development and data integration.
• Experience developing and maintaining SSIS packages and ETL processes.
• Experience with Azure Data Factory and Azure-based data engineering solutions.
• Strong proficiency with SQL and SQL Server.
• Experience with Oracle databases.
• Experience with Azure SQL.
• Experience working with Azure cloud services.
• Experience using Azure DevOps and Git for source code control and development collaboration.
• Experience working with healthcare data sets is strongly preferred.
• Experience designing, developing, and maintaining data warehouse solutions.
• Strong understanding of data pipeline architecture, data integration, and data delivery.
• Ability to identify opportunities to automate manual processes and improve data infrastructure scalability.
• Strong project management and organizational skills.
• Ability to work independently and manage multiple tasks and projects simultaneously.
• Ability and willingness to work in a high-tech, continually evolving, and innovative environment.
• Successful completion of required Healthcare Sanctions background check.

EDUCATION & EXPERIENCE

• Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field, or equivalent professional experience.
• Demonstrated professional experience in data engineering, ETL, data warehousing, database development, or a related discipline.
• Project management experience or demonstrated project management skills preferred.

CORE TECHNOLOGY ENVIRONMENT

Cloud & Development

• Azure
• Azure Data Factory
• Azure DevOps
• Git / Source Code Control
• Azure SQL

Data Engineering & Integration

• ETL / ELT
• SSIS
• Data Pipeline Architecture
• Data Transformation
• Data Integration
• Data Warehousing
• Metadata Management
• Workload Management

Databases

• SQL
• SQL Server
• Oracle
• Azure SQL

Industry/Data

• Healthcare Data Sets
• Healthcare Data Integration
• Data Analytics
• Business Intelligence

IDEAL CANDIDATE PROFILE

The ideal candidate is a hands-on Data Engineer with strong experience building and supporting enterprise data pipelines and data warehouse environments. They should bring a combination of SQL/SQL Server, Oracle, SSIS, Azure Data Factory, Azure SQL, and Azure cloud experience, along with familiarity with Azure DevOps/Git development practices.

Experience working with healthcare data sets would be particularly valuable given our client''s healthcare environment. The successful candidate should also be comfortable working cross-functionally with software engineers, database architects, analysts, and business stakeholders while independently managing multiple data initiatives.