Quick overview
Job description
Job Description
- Design, build, and maintain highly scalable, reliable, and efficient data pipelines for extracting, transforming, and loading (ETL/ELT) data from various sources into data warehouses, data lakes, and other storage systems.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure the efficient flow of data across various platforms and systems.
- Develop, deploy, and maintain real-time data streaming solutions to process and deliver data with low latency (using tools like Apache Kafka, Flink, or Spark Streaming). Optimize and automate data workflows, ensuring that data pipelines are efficient, reliable, and capable of handling increasing data volumes. Oversee the development of data models and schema designs to ensure accurate, accessible, and high-performance data storage for analytics and reporting.
- Ensure data quality, integrity, and consistency by implementing data validation, monitoring, and error-handling mechanisms.
- Monitor and troubleshoot performance bottlenecks in data systems, resolving issues with data processing and data access.
- Stay current with emerging trends and best practices in data engineering, recommending new tools, technologies, and methods to enhance existing infrastructure.
- Mentor and guide junior data engineers, promoting best practices in data engineering and fostering a collaborative, high-performance team environment.
Education and Background
Years of Experience
Required Skills
- Have active active TS/SCI clearance
- Minimum of eight years’ experience managing digital projects in support of SOF Enteprise customers
Preferred Skills
- Three years experience managing SOF agile development processes
- Three years experience managing SOF Data Operations processes and procedures
- Three years experience managing SOF digital support request requirements, translating them from customer requests to assigning customer and digital support teams
Working Conditions
- Happy - Be Infectious. Happiness multiplies and creates a positive and connected environment where motivation and satisfaction have an outsized effect on everything we do.
- Helpful - Be Supportive. Being helpful is the foundation of teamwork, resulting in a supportive atmosphere where collaboration flourishes, and collective success is celebrated.
- Honest - Be Trustworthy. Honesty serves as our compass, ensuring transparent communication and ethical conduct, essential to who we are and the complex domains we support.
- Humble - Be Grounded. Success is not achieved alone, humility ensures a culture of mutual respect, encouraging open communication, and a willingness to learn from one another and take on any task.
- Hungry - Be Eager. Our hunger for excellence drives an insatiable appetite for innovation and continuous improvement, propelling us forward in the face of new and unprecedented challenges.
- Hustle - Be Driven. Hustle is reflected in our relentless work ethic, where we are each committed to going above and beyond to advance the mission and achieve success.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- MO

Senior Data Engineer Auto Apply
Momsmeals · Ankeny · Remote 🇺🇸
Stakeholder ManagementSQLEncryption+9Technology$120k - $130k/yr - GA

Senior Databricks Apps Full-Stack Engineer Auto Apply
Growth Acceleration Partners · Austin · Hybrid · Posted 3 Nov 2026 🇺🇸
FastAPISQLApache+7TechnologySalary not listed - GA

Staff Data EngineerRecently posted Auto Apply
Gamechanger · GameChanger Remote - US · Remote · Posted 18 Nov 2026 🇺🇸
SQLAWSMLOps+8Technology$170k - $185k/yr - GH

Staff Data EngineerRecently posted Auto Apply
Garner Health · New York City · Hybrid · Posted 18 Nov 2026 🇺🇸
SQLAWSLooker+13Technology$256k - $287k/yr - LA
Data Engineer IIRecently posted Auto Apply
Lantern · Dallas · Hybrid · Posted 19 Nov 2026 🇺🇸
Talent AcquisitionGCPSQL+7TechnologySalary not listed - CL

Founding Data EngineerRecently posted Auto Apply
Clera · San Francisco · On-site · Posted 18 Nov 2026 🇺🇸
SQLBigQueryERP+5Technology$170k - $200k/yr - MI
Lead Forward Deployed Engineer, Data Auto Apply
Midstream · United States · Remote · Posted 12 Nov 2026 🇺🇸
OnboardingWorkdayOracle+9EngineeringSalary not listed - MA

Senior Data EngineerRecently posted Auto Apply
Machinify · United States · Remote · Posted 18 Nov 2026 🇺🇸
SQLApache SparkAWS+3Technology$180k - $220k/yr - MA

Staff Data Engineer, Core MigrationsRecently posted Auto Apply
Machinify · United States · Remote · Posted 18 Nov 2026 🇺🇸
SQLT-SQLApache Spark+7Technology$230k - $260k/yr - MA

Senior Data Engineer - AnalyticsRecently posted Auto Apply
Machinify · United States · Remote · Posted 18 Nov 2026 🇺🇸
SQLMicrosoft ExcelGit+14Technology$170k - $200k/yr - AB

Associate Data Engineer IIRecently posted Auto Apply
AbbVie · Mettawa, IL · Hybrid · Posted 18 Nov 2026 🇺🇸
Data AnalysisTechnology$65.5k - $125.5k/yr - ME

Customer Data Platform (CDP) ManagerRecently posted Auto Apply
Monster Energy · USA - Corona · Hybrid · Posted 18 Nov 2026 🇺🇸
SQLLookerCRM+3$116.3k/yr
