Haystack
← Back to Jobs
Technology

Senior Data Platform Engineer with Security Clearance

NuAxis Innovations LLCWashington, DC🇺🇸United StatesPosted 7 Aug 2026

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

We are a federal IT company on a mission to make customer experience (CX) the center of every government solution. Technology is our Passion. People are our Purpose. We know tech, but we love people. NuAxis is home to thinkers and feelers, engineers and artists. We work hard and support each other along the way. Teamwork is more than just a buzzword for us; it's a state of mind. We believe happy employees do amazing work, so join our team NOW! We are currently seeking a talented and motivated Senior Data Platform Engineer for a remote federal program opportunity on our team. Position Overview The Senior Data Platform Engineer serves as a hands-on technical lead for the Federal Client Datahub, an event-driven data platform built on the Confluent Platform for Apache Kafka and deployed on Kubernetes. The role owns the full portfolio of Java microservices - Kafka consumers, producers, and Kafka Streams applications, as well as non-Kafka services such as REST API web services - along with the deployment and ongoing maintenance of the supporting Confluent Platform and an Elasticsearch cluster. Beyond the data platform, this position serves as solution architect, technical subject matter expert, and senior technical decision maker for the wider FLAG system, and acts as a technical point of contact for DOL stakeholders and integrating federal partner teams. Key Responsibilities * Kafka Streams application development - Design, build, and maintain stream processing applications including stateful topologies, foreign-key joins, and state stores.
* Microservice and integration development - Build and maintain Spring Boot services, Kafka consumer/producer applications, and REST API web services integrating with Oracle, MySQL, MongoDB, Elasticsearch, managed search services, and downstream partner APIs.
* Kubernetes workload engineering - Own the deployment topology for all platform workloads: StatefulSets with persistent state, liveness/readiness/startup probes, pod anti-affinity, PodDisruptionBudgets, graceful shutdown, and resilience to node lifecycle and consolidation events.
* Production operations and incident response - Serve as senior escalation for production issues; perform root-cause analysis across the stack (JVM, Kafka client, DNS/networking, database, container runtime) and produce written RCAs with corrective actions.
* Confluent Platform and Elasticsearch administration - Deploy, configure, upgrade, and tune the Confluent Platform components (brokers, Connect, Schema Registry, REST Proxy) and the Elasticsearch cluster; manage schema compatibility, connector configuration, consumer group offsets, index lifecycle and versioned index migrations, topic sizing, and storage expansion.
* Database and query engineering - Own data access and query performance across Oracle, MySQL, MongoDB, Elasticsearch, and Azure Search indexes - including PL/SQL and reporting views, document modeling and aggregation pipelines, index mappings and query DSL, and search index schema design; diagnose performance regressions and environment-specific data issues.
* Solution architecture and technical leadership - Provide architectural direction and technical decision-making for the wider FLAG system, including integration points with the Appian application and the public-facing web applications.
* Stakeholder engagement - Act as a technical point of contact for DOL government stakeholders and integrating federal partner teams; translate technical constraints into clear options and tradeoffs for non-engineering decision makers.
* Platform modernization - Lead framework and runtime upgrades across the codebase (JDK, Spring Boot, serialization libraries, client SDKs), including compatibility analysis, remediation, and phased rollout through environments.
* Security compliance and vulnerability remediation - Execute recurring container image scan cycles; remediate CVEs via Dockerfile changes and dependency overrides, and author false-positive and risk-acceptance justifications that meet federal POA&M documentation standards.
* Observability and monitoring - Build dashboards, log-based metrics, and alerting for service health and availability; instrument applications for meaningful operational signals.
* Technical communication and mentorship - Write design documents, migration plans, and recommendation memos; mentor other developers on the platform and its operational practices.
Technical Skills and Capabilities Core Languages and Frameworks * Java (required)
* Spring Boot, Spring Framework, Spring Data
* Maven multi-module builds
* SQL / PL-SQL
Streaming and Messaging * Apache Kafka (brokers, topics, partitions, consumer groups, offsets, KRaft)
* Kafka Streams (stateful processing, joins, state stores, application reset, rebalancing/threading model)
* Confluent Platform (Schema Registry, Kafka Connect, REST Proxy)
* Apache Avro and schema evolution/compatibility
* Kafka Connect connectors (JDBC sink/source, Elasticsearch sink)
Cloud and Container Platform * Kubernetes (Deployments, StatefulSets, PVCs, probes, PDBs, anti-affinity, HPA, ConfigMaps/Secrets)
* Docker and container image hardening
* Helm, kubectl
* AWS (EKS, EC2, S3, IAM, CloudWatch, Lambda, EventBridge, ECR)
* Azure exposure (desirable)
Data Stores and Search * Oracle Database (query tuning, stored procedures, views, execution plans)
* MySQL
* Elasticsearch (index design, aliases, versioned index migration, Java client, PIT pagination, cluster deployment and upgrades)
* MongoDB (CosmosDB Mongo API)
* Managed search services such as Azure AI Search
Operations, Security, and Tooling * Observability: CloudWatch Logs Insights, log-based metrics, dashboards, alerting
* Container vulnerability scanning and remediation
* Git, CI/CD pipelines, Linux development environments
* REST API design and OpenAPI/Swagger documentation
Does this opportunity sound like a fit for you? If so, join our talent community and click to apply now!! Our Profile: We are an IT company with a unique mission-to make people the center of every federal IT solution. Our technologists have always gone the extra mile to help our federal clients succeed. And over the years, we saw a growing disconnect in how federal IT initiatives were built and managed.Time after time, programs failed because the focus was on the tools and products and not the people using them. Learn More. NuAxis is an Equal Opportunity/Affirmative Action Employer, including Vets and Disabled. Employment is contingent upon successful completion of a background investigation. Learn More about our Benefits and Culture! #NAI #DICE

Skills

Docker
Microservices
MongoDB
MySQL
Oracle
PL/SQL
SQL
Spring
Spring Boot
AWS
Apache
Azure
DNS
Git
Helm
Java
Kafka
Kubernetes
REST

Similar jobs