Technology

Data Engineer with Flink and Kafka

LiveMindzColumbus, OH🇺🇸United StatesPosted Oct 21, 2026

Quick Overview

Seniority

Mid Senior

Work mode

Hybrid

Location

Columbus, OH, United States

Posted

17 hours ago

DockerSQLGitFlinkApacheJavaKafkaPythonRESTKubernetesCI/CDLinuxMaven

Job Description

Job Title: Data Engineer with Flink and Kafka

Location: Columbus, OH

Job Summary

We are looking for an experienced Data Engineer with strong expertise in Apache Flink and Apache Kafka to design, develop, and maintain scalable, real-time data processing pipelines. The candidate will work on high-volume streaming data applications, ensuring low-latency processing, data quality, fault tolerance, and reliable integration with downstream systems.

Key Responsibilities

Design, develop, and maintain real-time data pipelines using Apache Flink and Apache Kafka.
Build stream-processing applications using Flink DataStream API, Table API, and Flink SQL.
Develop Kafka producers and consumers, manage topics and partitions, and optimize consumer groups.
Implement event-time processing, watermarks, windowing, stateful computations, and complex event processing.
Configure Flink checkpoints, savepoints, state backends, and recovery mechanisms.
Implement reliable streaming pipelines with appropriate delivery guarantees and idempotent processing.
Integrate Kafka and Flink with databases, data lakes, REST APIs, and downstream analytical platforms.
Perform performance tuning, troubleshoot latency, monitor backpressure, and resolve production issues.
Implement data validation, schema evolution, error handling, and dead-letter queue mechanisms.
Collaborate with architects, DevOps teams, business analysts, and other engineering teams.
Participate in code reviews, unit testing, integration testing, deployment, and production support.
Follow security, governance, coding standards, and CI/CD best practices.

Required Technical Skills

Strong programming experience in Java; Python is an added advantage.
Hands-on experience with Apache Kafka, including producers, consumers, topics, partitions, consumer groups, and offset management.
Practical experience with Apache Flink, including the DataStream API, Table API, and Flink SQL.
Good understanding of stream-processing concepts, event time, processing time, watermarks, windows, and state management.
Experience with checkpointing, fault tolerance, recovery, and exactly-once processing semantics.
Strong SQL skills and experience with relational or NoSQL databases.
Experience with REST APIs, JSON, Avro, Protobuf, and schema management.
Familiarity with Git, Maven or Gradle, CI/CD pipelines, and automated testing.
Experience with Linux, Docker, Kubernetes, or cloud-based data platforms is preferred.