Why This Role Stands Out
This remote Data Engineer role offers significant growth potential within the healthcare domain, allowing you to build and optimize robust data pipelines in a cutting-edge Databricks environment. You'll thrive here if you have a knack for data architecture, governance, and performance optimization, making a real impact on data quality and accessibility. Apply now to leverage your skills and contribute to innovative data solutions!
Quick Overview
Seniority
Mid Senior
Work mode
Remote
Location
United States
Posted
22 hours ago
AWSETLData PipelineDatabricksJiraPython
Job Description
Hi,
We do have an urgent requirement for the below position with our direct client, Please submit Resume, Rate and Contact details.
Job Title: Data Engineer
Location: Remote, USA
Duration: Short Term
Position Summary
Location: Remote, USA
Duration: Short Term
Position Summary
The Data Engineer will be responsible for designing, developing, and maintaining data pipelines, ensuring
Key Responsibilities
Data Pipeline Development
- Design and develop ETL/ELT data pipelines
- Ensure data pipelines are scalable, reliable, and efficient, meeting the needs of the organization.
- Implement and manage the data architecture, including Landing Zone, Bronze, Silver, and Gold layers within the Databricks environment.
- Develop processes for data cleaning, normalization, and enrichment to maintain high data quality standards.
- Integrate core data management with existing systems to ensure seamless data flow and consistency across platforms.
- Develop a comprehensive tagging system for core data, ensuring that all data assets are tagged appropriately for easy retrieval and association.
- Monitor and optimize the performance of data pipelines and processing workflows.
- Ensure data architecture supports different stages of the data lifecycle, from development to production, with appropriate access controls.
- Work closely with data scientists, data stewards, and other stakeholders to understand their data requirements and support their analytical needs.
- Provide technical support and guidance to other team members and departments as needed.
- Proven experience as a Data Engineer or in a similar role, with previous experience in the pharmaceutical industry being highly regarded.
- Hands-on experience with AWS, scripting and ETL pipelines
- Strong proficiency in programming languages such as Python
- Jira exp
- Strong analytical and problem-solving skills.
- Excellent understanding of ETL/ELT processes and data pipeline development.
- Knowledge of metadata management and data quality processes.
- Proficiency in data modeling, data warehousing, and big data processing frameworks.
- Excellent communication and collaboration skills.
- Ability to learn new technologies quickly and develop new skills as needed.
- Capable of identifying the best approach forward for various data engineering challenges.
- Ability to work in a fast-paced, dynamic environment and manage multiple priorities.
Similar jobs
- PE
Senior Data Engineer with Security Clearance
NewPrescient Edge
Augusta, GA🇺🇸Hybrid22 hours agoMATLABSQLScala+5Technology - RH
Senior Data Engineer with Security Clearance
NewRiver Hawk Consulting LLC
Mc Lean, VA🇺🇸Hybrid22 hours agoSQLAWSAgile+2Technology - FI
Data Engineer
NewFindem Inc.
McLean, VA🇺🇸Hybrid22 hours agoSQLAWSETL+8Technology - PE
Senior Data Engineer with Security Clearance
NewPrescient Edge
Washington, DC🇺🇸$160k - $180k/yrHybrid22 hours agoSQLETLData PipelineTechnology - PE
Mid Data Engineer with Security Clearance
NewPrescient Edge
Washington, DC🇺🇸$130k - $160k/yrHybrid22 hours agoSQLETLData PipelineTechnology - AS
Data Engineer
NewAgreeYa Solutions
El Segundo, CA🇺🇸Hybrid22 hours agoSQLAWSETL+6Technology