Core Java + Apache Spark Engineer

We are seeking a Java Developer – Supervisory to join our team within a TechFin environment. The ideal candidate will have strong experience in Core Java, Apache Spark, and big data platforms and a proven ability to design and optimize large-scale data pipelines for credit risk analytics and regulatory reporting.

Responsibilities:

• Design, develop, optimize, and maintain scalable data pipelines using Core Java and Apache Spark for large-scale financial datasets.
• Lead batch processing initiatives for credit risk analytics, including stress loss (GSST, CCAR) and expected credit loss (CECL, IFRS9, ICAAP).
• Ensure efficient storage, retrieval, and governance of risk data across Hadoop, Hive, Impala, and Spark ecosystems.
• Implement Spark performance best practices such as partitioning, caching, and memory management.
• Maintain code quality through automated testing, CI/CD pipelines (Tekton, Harness), and GitHub-based workflows.
• Collaborate with cross-functional teams to deliver compliant, reliable solutions for regulatory reporting.

Required Skills & Qualifications:

• 7+ years of software development with Core Java and Java 8 concepts, including OOP, OOD, Collections, Exception Handling, JDBC, Multithreading, Streams, Lambda Expressions, and Functional Interfaces.
• 2+ years of Apache Spark (Java API) with RDD, DataFrame, and Dataset expertise.
• 5+ years of SQL/NoSQL databases such as Oracle, MySQL, Postgres, MongoDB, Couchbase, or Neo4j.
• 3+ years leading or owning projects end-to-end with multi-team collaboration.
• Experience in financial markets and credit risk systems, including scenario analysis and stress testing.
• Proficiency with GitHub, Tekton, Harness, and CI/CD practices.
• Ability to operate in a fast-paced environment and deliver reliable code.

Preferred Skills:

• Experience with Hadoop ecosystem tools such as Hive and Impala in production workloads.
• Experience with agentic AI tooling (e.g., Devin, Claude, or Copilot) to enhance development productivity.
• Background in Agile delivery and test automation practices.