Confluent Kafka Architect with Flink

Job Description -

Role: Confluent Kafka Architect with Flink

Location: Remote

DevOps-Middleware Collaboration and Migration

Support OCC DevOps and middleware teams with Deployment of FLINK environments as well as VVP -> FLINK Migration:

1. Knowledge of Ververika ("VVP") Platform and Flink as we are migrating off VVP to Confluent Flink.
2. Flink application engineering - understanding existing jobs, dependencies, statefulness, Flink versions, jars, and any code/library changes needed during migration.
3. Kafka + event-stream validation - comparing VVP vs CMF outputs, record counts, key distributions, payload equality, consumer lag, and throughput under load.
4. Kubernetes / platform engineering - inventorying clusters and namespaces, creating equivalent Flink environments, and deploying CMF/FKO, namespaces, service accounts, role bindings, certs, and secrets. Managing, scaling, monitoring, and deploying streaming dataflow jobs securely across Kubernetes clusters using the Flink Kubernetes Operator and Confluent Manager for Apache Flink.
5. Knowledge transfer and addressing Helm deployment
6. Security / auth integration - Deciding and implementing OAuth vs mTLS, CRBs, and MDS exposure/access patterns.
7. CI/CD and automation - building harness pipelines, updating SRO/API endpoints, and validating deploy/update/rollback flows without manual in-cluster changes.
8. Operations / SRE / observability - dashboards, alerts, checkpoint health, backpressure, restart behavior, logs, savepoints, suspend/resume, and scaling parallelism.
9. Migration runbook + cutover planning - phased wave planning, shadow mode, rollback readiness, and per-app migration execution/checklists.
10. State migration expertise - state rebuild strategies and automations
11. Test management / QA - Hands on testing of pipelines, defining functional, non-functional, and operational validation criteria plus exit criteria per environment.