Why This Role Stands Out
This hybrid role offers a unique opportunity to directly impact national security by building cutting-edge data platforms and gaining hands-on experience with advanced technologies in operational environments. You'll thrive here if you're a mid-senior data engineer with a passion for solving complex challenges, excellent Python and Rust skills, and a U.S. Secret clearance. Apply now to advance your career in a mission-critical field with significant growth potential.
Quick Overview
Job Description
Job Description We're seeking a skilled Forward Deployed Data Engineer to help build next-generation data management and artificial intelligence platforms supporting maritime domain awareness missions. As a forward-deployed engineer, you'll work directly with customers-writing code, integrating systems, and solving complex technical challenges in operational environments. You'll serve as both an engineer and technical advisor, taking ownership of mission outcomes. This position requires a current or active U.S. Secret clearance.
This role offers the opportunity to work on real-world projects involving sensor systems, edge data collection, and large-scale maritime data processing environments that directly support operational mission success.
Responsibilities • Implement real-time data pipelines using MQTT and Redpanda for stream processing. • Implement offline data pipelines using Dagster for batch processing. • Parse and process binary message formats from various data sources. • Build data warehouses using PostgreSQL, Apache Iceberg, Parquet, and S3. • Design data models that support high-performance analytical queries. • Validate and normalize diverse data sources. • Improve local development environments and CI/CD workflows using modern tooling and GitHub Actions.
Required Skills Required Skills • Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.) • Proficiency in Python and Rust for data engineering workflows • Experience with binary message parsing • Experience with row-based and columnar data formats • Experience with OLTP and OLAP databases • Knowledge of distributed systems, streaming architectures, and batch processing patterns • Hands-on experience with workflow orchestration platforms such as Dagster or Airflow • Hands-on experience with streaming platforms such as Redpanda or Kafka • Experience working with binary message formats such as Protobuf Desired Skills Required Skills • Expertise in time-series data processing and analysis (windowing, resampling, interpolation, etc.) • Proficiency in Python and Rust for data engineering workflows • Experience with binary message parsing • Experience with row-based and columnar data formats • Experience with OLTP and OLAP databases • Knowledge of distributed systems, streaming architectures, and batch processing patterns • Hands-on experience with workflow orchestration platforms such as Dagster or Airflow • Hands-on experience with streaming platforms such as Redpanda or Kafka • Experience working with binary message formats such as Protobuf
Similar jobs
- DE
Senior Data Engineer - Principal Associate
Dev
Scranton, PENNSYLVANIA🇺🇸On-site2 years agoDynamoDBMicroservicesMySQL+16Technology - DE
Senior Data Engineer - Principal Associate
Dev
McLean, VIRGINIA🇺🇸On-site2 years agoDynamoDBMicroservicesMySQL+16Technology - DE
Distinguished Engineer, Enterprise Data Platforms - Data Creation
Dev
Waco, TEXAS🇺🇸On-site2 years agoScalaAWSMachine Learning+3Technology - DE
Manager, Data Engineering (Python, AWS, Airflow, Snowflake) (Hybrid)
Dev
Poughkeepsie, NEW YORK🇺🇸On-site2 years agoMySQLSQLScala+16Technology - DE
Manager, Data Engineering (Python, AWS, Airflow, Snowflake) (Hybrid)
Dev
New Haven, Connecticut🇺🇸On-site2 years agoMySQLSQLScala+16Technology - DE
Manager, Data Engineering (Python, AWS, Airflow, Snowflake) (Hybrid)
Dev
Philadelphia, PENNSYLVANIA🇺🇸On-site2 years agoMySQLSQLScala+16Technology