Quick overview
Job description
Title: Ab Initio Consultant
Role: Streaming Data Engineer Ab Initio, OzoneCH, Flink
Location: Berkeley Heights, NJ (5 Days Onsite)
F2F interview.
Job Description:
We are seeking a highly skilled resource to design and implement high-performance, event-driven data pipelines, ensuring low-latency data processing and high availability system for the large credit card processing system. The ideal candidate will work with the Ab Initio ecosystem (GDE, EME, Conduct>It) to build stateful services that ingest, filter, and transform data from sources like Kafka or message queues, pushing updates to dashboards or downstream databases in near-real-time.
Key Responsibilities:
- Create complex Ab Initio continuous flow graphs, including stateful joins, sliding time windows, and aggregations.
- Implement event-driven data pipelines using Kafka, MQ, and file streams.
- Ensure the resilience of continuous flows, including checkpointing and recovery, to guarantee "exactly-once" processing.
- Apply advanced Ab Initio components (e.g., Reformat, Rollup, Join, Partition) to ensure low-latency performance.
- Proactively monitor live production streams to ensure 24/7 reliability and troubleshooting data issues
- Develop ETL pipelines for batch and real-time data ingestion and transformation.
- Implement and ensure data validation, data security, integrity, and compliance across big data platforms.
- Monitor and troubleshoot performance issues in large-scale clusters.
- Collaborate with data scientists, analysts, and application teams to deliver high-quality data solutions.
- Automate workflows and improve operational efficiency using scripting and orchestration tools.
Required Skills & Qualifications:
- Deep understanding of credit card process system
- Deep knowledge of GDE (Graphical Development Environment), EME (Enterprise Meta>Environment), Conduct>It, and Continuous Flows.
- Understanding of Kafka, message queues, and real-time stateful services.
- Proficiency in Unix/Linux shell scripting, SQL, and database technologies (e.g., Oracle, Teradata).
- Experience in Java , Scala, Python or Kafka is plus.
- Familiarity with Linux/Unix environments and shell scripting.
- Understanding of data security, governance, and compliance standards.
- Experience with cloud-based big data platforms
- Exposure to containerization (Docker, Kubernetes) for big data workloads.
- Knowledge of CI/CD pipelines for data engineering projects.
Behavioral Skills:
- Good Communication skills
- 5 days Work from Office at Berkley Heights, NJ
- Team Player
- Ability to work in a changing environment
- Strong problem solving and analytical skills
- Ability to work independently or within a team
- Manage day-to-day challenges and communicate developmental risks with the technical team
Qualifications:
- Bachelor s degree in computer science, Software Engineering, or a related field.
- Proficiency in business process modeling and documentation tools.
- Product implementation experience is preferred
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- EX
IT Inventory AssociateRecently posted
Excelraise LLC · Kennesaw, GA · On-site · Posted 20 Nov 2026 🇺🇸
Microsoft ExcelMicrosoft OfficeInventory ControlSalary not listed - BT
Product AnalystRecently posted
Boston Technology Corporation · Columbus, OH · Hybrid · Posted 20 Nov 2026 🇺🇸
Business AnalysisSalary not listed - SS
Websphere Integration Tech-Remote(USA)-W2 Role -Exp 12+yrsRecently posted
SSTech LLC · United States · Remote · Posted 20 Nov 2026 🇺🇸
MicroservicesGitAWS+16Salary not listed - SO

Performance ConsultantRecently posted
System One · Fort Meade, MD · On-site · Posted 20 Nov 2026 🇺🇸
Stakeholder ManagementPortfolio ManagementRisk Management+2Salary not listed - SH

Set Your Own Schedule - Shop and Deliver GroceriesRecently posted
Shipt · Ogden, IL · Hybrid · Posted 20 Nov 2026 🇺🇸
AndroidSalary not listed - SH

Set Your Own Schedule - Shop and Deliver GroceriesRecently posted
Shipt · Seymour, IL · Hybrid · Posted 17 Nov 2026 🇺🇸
AndroidSalary not listed - TD

.NET ARCHITECTRecently posted
The Dignify Solutions, LLC · United States · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerMicroservicesSQL+7Salary not listed - AC

ADS & ADAS TechnicianRecently posted
AVA Consulting · Ann Arbor, MI · Hybrid · Posted 20 Nov 2026 🇺🇸
ADASASE CertificationVehicle DynamicsSalary not listed - TE
Administrative Athletic ManagerRecently posted
TECKNOMIC LLC · Washington, DC · On-site · Posted 20 Nov 2026 🇺🇸
CanvaSchedulingInstagramSalary not listed - MU

AI-Enabled Remediation Engineer(Linux)Recently posted
MphasiS Corporation USA · Alpharetta, GA · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerGitAWS+16Salary not listed - PN

Principal AI Researcher (Prisma AIRS)Recently posted
PaloAlto Networks · CA · On-site · Posted 20 Nov 2026 🇺🇸
PythonMachine LearningData Analysis$172.1k - $278.3k/yr - GR
End User Computing (EUC) Support Analyst in Albany, NYRecently posted
GD Resources LLC · Albany, NY · Hybrid · Posted 20 Nov 2026 🇺🇸
Microsoft OfficeActive DirectoryHelp Desk+4Salary not listed