Why This Role Stands Out
This hybrid role offers a unique opportunity to directly impact national security by building cutting-edge data platforms and gaining hands-on experience with advanced technologies in operational environments. You'll thrive here if you're a mid-senior data engineer with a passion for solving complex challenges, excellent Python and Rust skills, and a U.S. Secret clearance. Apply now to advance your career in a mission-critical field with significant growth potential.
Quick Overview
Job Description
Job Description We're seeking a skilled Forward Deployed Data Engineer to help build next-generation data management and artificial intelligence platforms supporting maritime domain awareness missions. As a forward-deployed engineer, you'll work directly with customers-writing code, integrating systems, and solving complex technical challenges in operational environments. You'll serve as both an engineer and technical advisor, taking ownership of mission outcomes. This position requires a current or active U.S. Secret clearance.
This role offers the opportunity to work on real-world projects involving sensor systems, edge data collection, and large-scale maritime data processing environments that directly support operational mission success.
Responsibilities • Implement real-time data pipelines using MQTT and Redpanda for stream processing. • Implement offline data pipelines using Dagster for batch processing. • Parse and process binary message formats from various data sources. • Build data warehouses using PostgreSQL, Apache Iceberg, Parquet, and S3. • Design data models that support high-performance analytical queries. • Validate and normalize diverse data sources. • Improve local development environments and CI/CD workflows using modern tooling and GitHub Actions.
Required Skills Required Skills • Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.) • Proficiency in Python and Rust for data engineering workflows • Experience with binary message parsing • Experience with row-based and columnar data formats • Experience with OLTP and OLAP databases • Knowledge of distributed systems, streaming architectures, and batch processing patterns • Hands-on experience with workflow orchestration platforms such as Dagster or Airflow • Hands-on experience with streaming platforms such as Redpanda or Kafka • Experience working with binary message formats such as Protobuf Desired Skills Required Skills • Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.) • Proficiency in Python and Rust for data engineering workflows • Experience with binary message parsing • Experience with row-based and columnar data formats • Experience with OLTP and OLAP databases • Knowledge of distributed systems, streaming architectures, and batch processing patterns • Hands-on experience with workflow orchestration platforms such as Dagster or Airflow • Hands-on experience with streaming platforms such as Redpanda or Kafka • Experience working with binary message formats such as Protobuf
Similar jobs
- WO
Senior Cybersecurity Data Engineer - Data Platform & Lakehouse S with Security Clearance
NewWorkday
Reston, VA🇺🇸$152k - $228k/yrHybrid22 hours agoSQLAWSEncryption+10Technology - IS
Data Architect / Senior Staff Data Engineer
NewiCUBE Solutions
Oakland, CA🇺🇸On-site22 hours agoSQLETLBigQuery+3Technology - BI
AWS Data Engineer Greenwood Village, CO_hybrid H1B and w2 or c2c F2F
NewBURGEON IT SERVICES LLC
Greenwood Village, CO🇺🇸On-site22 hours agoSQLScalaAWS+6Technology - RT
Azure Databricks / Python Data Engineer
NewRapsys Technologies
Fort Worth, TX🇺🇸Hybrid22 hours agoSQLETLAgile+11Technology - ML
Software/Data Engineer with Security Clearance
NewMIT Lincoln Laboratory
Lexington, MA🇺🇸$116.4k - $140k/yrHybrid22 hours agoMySQLSQLAWS+6Technology - IT
ETL DataStage Consultant
NewITBMS Inc.
Culver City, CA🇺🇸On-site22 hours agoSQLShellETL+3