Why This Role Stands Out
This hybrid role offers a unique opportunity to directly impact national security by building cutting-edge data platforms and gaining hands-on experience with advanced technologies in operational environments. You'll thrive here if you're a mid-senior data engineer with a passion for solving complex challenges, excellent Python and Rust skills, and a U.S. Secret clearance. Apply now to advance your career in a mission-critical field with significant growth potential.
Quick Overview
Job Description
Job Description We're seeking a skilled Forward Deployed Data Engineer to help build next-generation data management and artificial intelligence platforms supporting maritime domain awareness missions. As a forward-deployed engineer, you'll work directly with customers-writing code, integrating systems, and solving complex technical challenges in operational environments. You'll serve as both an engineer and technical advisor, taking ownership of mission outcomes. This position requires a current or active U.S. Secret clearance.
This role offers the opportunity to work on real-world projects involving sensor systems, edge data collection, and large-scale maritime data processing environments that directly support operational mission success.
Responsibilities • Implement real-time data pipelines using MQTT and Redpanda for stream processing. • Implement offline data pipelines using Dagster for batch processing. • Parse and process binary message formats from various data sources. • Build data warehouses using PostgreSQL, Apache Iceberg, Parquet, and S3. • Design data models that support high-performance analytical queries. • Validate and normalize diverse data sources. • Improve local development environments and CI/CD workflows using modern tooling and GitHub Actions.
Required Skills Required Skills • Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.) • Proficiency in Python and Rust for data engineering workflows • Experience with binary message parsing • Experience with row-based and columnar data formats • Experience with OLTP and OLAP databases • Knowledge of distributed systems, streaming architectures, and batch processing patterns • Hands-on experience with workflow orchestration platforms such as Dagster or Airflow • Hands-on experience with streaming platforms such as Redpanda or Kafka • Experience working with binary message formats such as Protobuf Desired Skills Required Skills • Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.) • Proficiency in Python and Rust for data engineering workflows • Experience with binary message parsing • Experience with row-based and columnar data formats • Experience with OLTP and OLAP databases • Knowledge of distributed systems, streaming architectures, and batch processing patterns • Hands-on experience with workflow orchestration platforms such as Dagster or Airflow • Hands-on experience with streaming platforms such as Redpanda or Kafka • Experience working with binary message formats such as Protobuf
Similar jobs
- AR
Data Engineer
NewArrowminds inc
New York, NY🇺🇸On-site19 hours agoSQLAWSETL+2Technology - SI
W2 only || Senior Data Engineer (GenAI / AWS) || Los Angeles, California- Must be Local
NewStellent IT LLC
Los Angeles, CA🇺🇸On-site19 hours agoSQLGitAWS+11Technology - LT
Data Engineer
NewLorven Technologies, Inc.
Menlo Park, CA🇺🇸Hybrid19 hours agoSQLMicrosoft OfficeETL+5Technology - KO
Senior Data Engineer
NewKONNECTINGTREE INC
New York, NY🇺🇸Hybrid19 hours agoSQLAWSETL+6Technology - XO
Azure Data Engineer
NewXoriant Corporation
Montvale, NJ🇺🇸Hybrid19 hours agoSQLT-SQLApache Spark+6Technology - RE
Senior Enterprise Applications & Data Engineer
NewResourcesoft, Inc.
Battle Creek, MI🇺🇸Hybrid19 hours agoSQLMicrosoft OfficeETL+6Technology - SB
Azure Data Engineer
NewSynapse Business Systems
Washington, DC🇺🇸Hybrid19 hours agoSQLScalaGit+7Technology - TE
Data Engineer - San Antonio, TX, Dallas, TX, Austin, TX, Houston, TX
NewTechniPros, LLC
San Antonio, TX🇺🇸Hybrid19 hours agoDockerSQLGit+9Technology - ST
Senior Data Scientist / Data Engineer – Google Cloud Platform, BigQuery, Looker & Machine Learning - San Ramon CA - Fully onsite – $120/HR - APPLY
NewSynersys Technologies
San Ramon, CA🇺🇸$120/hrOn-site19 hours agoSQLGitETL+16Technology - LI
Data Engineer with Data Bricks
NewLiveMindz
Columbus, OH🇺🇸Hybrid19 hours agoSQLJavaPythonTechnology - RI
Senior Data Engineer – Snowflake & AWS -- W2
NewResource Innovative Technologies LLC
Seattle, WA🇺🇸Hybrid19 hours agoSQLAWSETL+3Technology - RX
Senior Data Engineer
NewAuto ApplyRxSense
Remote-US🇺🇸Remote8 hours agoGCPSQLGit+11Technology