Abinitio developer

Hi,

\n

I hope you are doing well.

\n

I am sharing you job description please check below job description let me know if you are interested for this role.

\n

Job Title : Ab initio developer

\n

Location: Berkeley Height, NJ Onsite

\n\n

We are seeking a highly skilled resource to design and implement high-performance, event-driven data pipelines, ensuring low-latency data processing and high availability system for the large credit card processing system. The ideal candidate will work with the Ab Initio ecosystem (GDE, EME, Conduct>It) to build stateful services that ingest, filter, and transform data from sources like Kafka or message queues, pushing updates to dashboards or downstream databases in near-real-time.

\n\n

Key Responsibilities:

\n

• Create complex Ab Initio continuous flow graphs, including stateful joins, sliding time windows, and aggregations.

\n

• Implement event-driven data pipelines using Kafka, MQ, and file streams.

\n

• Ensure the resilience of continuous flows, including checkpointing and recovery, to guarantee "exactly-once" processing.

\n

• Apply advanced Ab Initio components (e.g., Reformat, Rollup, Join, Partition) to ensure low-latency performance.

\n

• Proactively monitor live production streams to ensure 24/7 reliability and troubleshooting data issues

\n

• Develop ETL pipelines for batch and real-time data ingestion and transformation.

\n

• Implement and ensure data validation, data security, integrity, and compliance across big data platforms.

\n

• Monitor and troubleshoot performance issues in large-scale clusters.

\n

• Collaborate with data scientists, analysts, and application teams to deliver high-quality data solutions.

\n

• Automate workflows and improve operational efficiency using scripting and orchestration tools.

\n

Required Skills & Qualifications:

\n

• Deep understanding of credit card process system

\n

• Deep knowledge of GDE (Graphical Development Environment), EME (Enterprise Meta>Environment), Conduct>It, and Continuous Flows.

\n

• Understanding of Kafka, message queues, and real-time stateful services.

\n

• Proficiency in Unix/Linux shell scripting, SQL, and database technologies (e.g., Oracle, Teradata).

\n

• Experience in Java , Scala, Python or Kafka is plus.

\n

• Familiarity with Linux/Unix environments and shell scripting.

\n

• Understanding of data security, governance, and compliance standards.

\n

• Experience with cloud-based big data platforms

\n

• Exposure to containerization (Docker, Kubernetes) for big data workloads.

\n

• Knowledge of CI/CD pipelines for data engineering projects.

\n

Behavioral Skills:

\n

• Good Communication skills

\n

• 5 days’ Work from Office at Berkley Heights, NJ

\n

• Team Player

\n

• Ability to work in a changing environment

\n

• Strong problem solving and analytical skills

\n

• Ability to work independently or within a team

\n

• Manage day-to-day challenges and communicate developmental risks with the technical team

\n\n

Qualifications:

\n

• Bachelor’s degree in computer science, Software Engineering, or a related field.

\n

• Proficiency in business process modeling and documentation tools.

\n

• Product implementation experience is preferred

\n