ETL Developer

Develop and maintain Apache NiFi data pipelines for a geospatial visualization platform, moving and transforming data into PostgreSQL. Troubleshoot AWS and database issues, integrate external APIs, query large datasets, and support data quality and performance. Requires U.S. citizenship and an active TS/SCI clearance with polygraph; the role is full-time onsite in McLean, Virginia.

Responsibilities

• Design, develop, and maintain Apache Ni
• Fi ETL workflows.
• Monitor and troubleshoot Ni
• Fi, AWS, and PostgreSQL infrastructure.
• Build new Ni
• Fi flows and revise them based on feedback and established practices.
• Work with analysts to translate data needs into specific flow requirements.
• Transform data from multiple sources and retrieve data from external systems through APIs.
• Query large datasets using SQL and support data quality, integrity, and performance optimization.

Required Skills

• Apache Ni
• Fi
• ETL workflow development
• Postgre
• SQLSQLAWSAPI integration
• Data transformation
• Large dataset querying
• Python
• Git and Ni
• Fi Registry