Data Engineer
Why This Role Stands Out
This hybrid Data Engineer role offers a unique opportunity to shape a critical data migration strategy, developing valuable skills in advanced scanning techniques and data analysis. You'll thrive here if you have strong Unix Shell Scripting and PL/SQL experience and are eager to contribute to a significant technological transformation within a reputable organization. Apply now to be part of this exciting project!
Quick Overview
Job Description
Inside IR35 - Hybrid - Must have an active SC Clearance
Job Description:
An experienced Data Engineer is required to support the CDW SA team in delivering DWIT Informatica Advanced Scans across Legacy data warehouses. This role is a key enabler for the strategic migration from Legacy data warehouses to the new Data Lakehouse architecture.
The successful candidate will work closely with DWIT and CDW stakeholders to establish a comprehensive and accurate as is view of each Legacy warehouse, leveraging Informatica Advanced Scanning capabilities wherever possible.
Key Responsibilities:
- Perform detailed analysis of Legacy data warehouses using Informatica Advanced Scanning techniques.
- Produce a complete and accurate as is representation of each data warehouse.
Identify and document all inbound data feeds consumed by CDW, including:
- Source/origin systems
- Data formats
- Full feed by feed data content
Capture and document the actual metadata held within the data warehouse, including:
- Table structures
- Field names and definitions
Identify and document all outbound data feeds from the data warehouse, including:
- Consuming systems or platforms
- Full feed by feed data content
- Outbound metadata (tables, fields, and structures)
- Where possible, generate bespoke outputs from Informatica Advanced Scanning for each Legacy warehouse to support analysis and migration planning.
- Collaborate with architecture, data, and migration teams to ensure outputs are aligned to Data Lakehouse migration objectives.
- Ensure documentation is clear, accurate, and suitable for use in downstream migration and governance activities.
Required Skills and Experience:
- Strong experience with Unix Shell Scripting
- PL/SQL and Oracle SQLMaestro/TWS scheduling tools
- ETL concepts and implementationsCommand line tools (PuTTY/CLI)File transfer tools (eg WinSCP)
- Use of text and documentation tools (eg Notepad , Word or equivalent)
Desirable Knowledge and Experience:
- SA Profiles extractsSA MARTsSA Warehouse structures and concepts
- Caseflow and KBSAuthoreteEureka
- Business Objects tooling: BO Infoview
- BO Developer
- BO CMC
- BO Import Wizard
Additional Information:
This role is hands on and delivery focused, supporting a critical phase of Legacy to Lakehouse migration.
Strong attention to detail, documentation quality, and stakeholder collaboration are essential.
If you are looking for your next opportunity, please contact me
Skills
Similar jobs
Data Modeller
Harvey Nash Plc · Glasgow, United Kingdom
53 minutes agoData Engineer (SC Clearance Required) | Inside IR35 | £500 per day | 1 day in London per week
Solirius Limited · United Kingdom
53 minutes agoData Engineer
Low Carbon Contracts Company · United Kingdom
53 minutes ago£62k/yrAzure Data Engineer (Power BI expertise) London - Perm
Accion Labs UK Ltd · United Kingdom
53 minutes agoData Engineer
PWS Technical Services LTD · Farringdon, United Kingdom
1 hour agoLead Data Engineer £400pd - Outside IR35
Vermillion Analytics · Farringdon, United Kingdom
1 hour ago