Quick overview
Job description
Zachary Piper Solutions is seeking a Big Data Engineer to support a company focused on delivering mission-critical data platform capabilities within the defense and intelligence sector. This position is on-site in Honolulu, HI . An active TS/SCI clearance is required. The Big Data Engineer will design, build, and maintain secure real-time and near-real-time data ingestion pipelines that support operational decision-making across complex data environments. This is an opportunity to play a key role in ensuring reliable, low-latency data delivery for high-impact mission operations. Responsibilities for the Big Data Engineer include:
- Design, build, and maintain resilient real-time and near-real-time data ingestion pipelines utilizing Apache NiFi, REST APIs, and streaming data architectures.
- Configure, monitor, and optimize data movement across security domains while ensuring data integrity, compliance, and operational reliability.
- Parse, transform, validate, and route structured and unstructured datasets including CSV, JSON, XML, and Excel formats.
- Develop automation scripts using Python, Bash, or similar technologies to support data processing, monitoring, alerting, and data quality validation.
- Collaborate with platform, software, security, and data engineering teams to improve pipeline performance, observability, scalability, and operational effectiveness. Required Qualifications for the Big Data Engineer include:
- 3+ years of experience in data engineering, data operations, DevOps, or a related role supporting production data pipelines.
- Experience with Apache NiFi, REST APIs, and real-time or near-real-time data ingestion architectures.
- Proficiency with Python, Bash, or similar scripting languages.
- Working knowledge of Linux (RedHat) environments and command-line administration.
- Experience working with ETL/ELT processes, streaming architectures, data quality practices, and data transformation workflows.
- Familiarity with JSON, XML, CSV, and Excel data formats.
- Strong understanding of monitoring, troubleshooting, and operational support for enterprise data pipelines.
- Bachelor's degree in Computer Science, Mathematics, Electrical Engineering, Physics, Information Systems, Information Technology, or a related technical field.
- Active TS/SCI Clearance.
Preferred Qualifications for the Big Data Engineer include
- Experience with Kafka, JMS, Apache Flink, Spark Streaming, or similar messaging and streaming technologies.
- Experience with Grafana, Prometheus, Elasticsearch, or other observability platforms.
- Experience with Snowflake or enterprise-scale data platforms.
- Familiarity with cross-domain solutions, data transfer validation, content filtering, or secure data movement concepts.
- Experience implementing encryption, authentication, authorization, and data classification controls.
- Experience with Git, Agile methodologies, and Scrum environments.
- Prior experience supporting government, defense, or intelligence community programs.
Compensation for the Big Data Engineer includes: Salary Range: $120,000 - $180,000+ depending on experience Full Benefits Package: PTO, Paid Holidays, Medical, Dental, Vision, 401K, Sick Leave as Required by Law SEO Keywords: Big Data Engineer, Data Engineer, Apache NiFi, Data Pipelines, Real-Time Data Processing, Near Real-Time Data Ingestion, ETL, ELT, Streaming Data, Kafka, Apache Flink, Spark Streaming, REST API, Python Developer, Bash Scripting, Linux Engineer, RedHat Linux, Data Operations, DevOps Engineer, Data Platform Engineer, Grafana, Prometheus, Elasticsearch, Snowflake, Data Quality, Data Validation, Data Integration, Cross Domain Solutions, CDS, Secure Data Transfer, TS/SCI Clearance Jobs, Defense Technology, Intelligence Community, Data Analytics Infrastructure, Enterprise Data Engineering, Mission-Critical Systems, Big Data Platform, Data Monitoring, Data Automation, Git, Agile, Scrum, Honolulu Hawaii Jobs, On-Site Engineering Jobs, Hawaii, Oahu, Maui.
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- EG

Data Engineer with Security ClearanceRecently posted
Eliassen Group · Saint Louis, MO · On-site · Posted 18 Nov 2026 🇺🇸
GCPSQLScala+10TechnologySalary not listed - SI

Data Engineer -- 2/3 days a Week in Dayton, OH -- Only W2Recently posted
Siri Infosolutions Inc · Trotwood, OH · On-site · Posted 19 Nov 2026 🇺🇸
ETLAzureTechnologySalary not listed - GD

NCIS Data Engineer | Active Secret clearance
General Dynamics Information Technology · Quantico, VA · Hybrid 🇺🇸
DockerPL/SQLSQL+14Technology$142.8k - $166.8k/yr - BA

Mid Data EngineerRecently posted
Booz Allen Hamilton · Fort Belvoir, VA · On-site · Posted 18 Nov 2026 🇺🇸
DockerSQLGit+17Technology$62k - $141k/yr - EG

Data Engineer - PlatformRecently posted
Eliassen Group · Glendale, CA · On-site · Posted 20 Nov 2026 🇺🇸
SQLScalaScrum+5Technology$74 - $84/hr - PE

Mid-Level Data Engineer / Active Top Secret with SCI and Polygra with Security ClearanceRecently posted
Peraton · Washington, DC · On-site · Posted 19 Nov 2026 🇺🇸
ETLData PipelineData AnalysisTechnology$86k - $138k/yr - BA

Data EngineerRecently posted
Booz Allen Hamilton · Charlottesville, VA · On-site · Posted 19 Nov 2026 🇺🇸
SQLAWSETL+8Technology$99k - $225k/yr - GA

Staff Data EngineerRecently posted
GE Aerospace · United States · Remote · Posted 19 Nov 2026 🇺🇸
SQLGitApache Spark+8Technology$112k - $150k/yr - BA

Data Engineer with Security ClearanceRecently posted
Booz Allen Hamilton · Charlottesville, VA · On-site · Posted 19 Nov 2026 🇺🇸
SQLAWSETL+8Technology$99k - $225k/yr - RD

Data Systems EngineerRecently posted
Randstad Digital · Marietta, OH · Hybrid · Posted 20 Nov 2026 🇺🇸
SQL.NETC+++1Technology$38 - $41/hr - BA

Data EngineerRecently posted
Booz Allen Hamilton · Washington, DC · On-site · Posted 20 Nov 2026 🇺🇸
SQLETLIoT+5Technology$62k - $141k/yr - GE

Senior Data Engineer - HybridRecently posted
Genesis10 · Eagan, MN · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLShellGit+10Technology$79 - $89/hr
