Quick Overview
Job Description
What you’ll do: Work with team members to operationalize data pipelines and supporting cloud infrastructure Collaborate with external data producers and consumers to obtain and provide data through interfaces such as REST APIs and S3 Provide day-to-day support of deploying Python-native data pipelines and performing data engineering tasks to enable data brokering and exchange capabilities Provide Tier 2/3 troubleshooting and incident resolution support for data pipelines in Production What you’ll need to succeed: Active TS/SCI with CI poly required 4+ years of proven experience in data engineering, with expertise in designing, developing, and maintaining data ingestion, transformation, and loading pipelines and components Demonstrated experience in designing and deploying data pipelines leveraging AWS cloud infrastructure across multiple classification domains (e.g., IL5 to IL6+) Experience with Infrastructure-as-Code (IaC) tools, including Terraform, CloudFormation, or Ansible, to automate deployment of data pipeline cloud infrastructure Understanding of RMF security principles and hands-on experience implementing security controls for data pipelines in cloud environments Strong scripting and programming skills in languages such as Go, Python, and Bash Experience with data pipeline tools and technologies such as Nifi, Hadoop, HDFS, and Kafka.
Experience implementing data pipelines in the Cloudera Data Platform environment is highly preferred. Strong communication skills, with the ability to clearly convey complex technical concepts
Similar jobs
- AS
Systems Engineer - Systems Engineer III
NewApex Systems
Spokane, WA🇺🇸Hybrid12 hours agoMercurialSQLSVN+9Technology - AS
OT Network Engineer
NewApex Systems
Findlay, OH🇺🇸Hybrid12 hours agoTCP/IPTechnology - AI
Site Reliability Engineer, Cyber with Security Clearance
NewAnduril Industries
Arlington, VA🇺🇸$146k - $220k/yrOn-site12 hours agoBashComputer VisionKubernetes+1Technology - AS
Sr. Data and AI Engineer
NewApex Systems
Arlington, VA🇺🇸$180k - $200k/yrRemote12 hours agoDjangoFlaskAWS+9Technology - AS
Java Developer
NewApex Systems
Bentonville, AR🇺🇸Hybrid2 days agoDockerSQLSpring+7Technology - SG
Exclusive S&P Global Ratings Early Careers Networking Event
NewS&P Global
New York, NY🇺🇸Hybrid12 hours agoMachine LearningNLPMicrosoft OfficeTechnology