Data Engineer

Greetings!

One of our direct client is looking to hire Data Engineer in Newark New Jersey, This is long term contractual opportunity. Please find below job description and share your updated resume.

Interview Mode:- In-Person

Key Responsibilities:

• Design, build, and maintain a centralized Market Data Hub to consolidate data from multiple third-party market data vendors.
• Develop scalable data ingestion pipelines from EDM platforms (e.g., GoldenSource, Gresham, RIMES, Bloomberg) into Microsoft Fabric.
• Design and implement Medallion Architecture (Bronze, Silver, Gold layers) within Microsoft Fabric for enterprise data management.
• Create and maintain ETL/ELT processes for integrating, cleansing, enriching, and transforming market data feeds.
• Build and implement data quality rules, validation frameworks, reconciliation checks, and monitoring processes to ensure data accuracy and completeness.
• Develop data extraction and distribution mechanisms from EDM platforms to support downstream business and analytical applications.
• Perform onboarding, mapping, and integration of new market data sources into the enterprise Market Data Hub.
• Migrate existing market data ingestion, transformation, and distribution processes to Microsoft Fabric and EDM-based architecture.
• Design and maintain interfaces that enable efficient data flow between market data providers, EDM platforms, Microsoft Fabric, and downstream consumers.
• Collaborate with business, data governance, and technology teams to deliver scalable, reliable, and governed data solutions.
• Implement data governance, lineage, cataloging, and compliance controls using Microsoft Purview or similar governance tools.
• Optimize data pipelines and data models to support high-volume market data processing, reporting, and operational use cases.

Thanks and Regards

Saurav Upadhyay

Iris Software

200 Metroplex Drive, Suite #300

Edison, NJ 08817

Mobile:

|