Quick overview
Job description
Overview We are seeking an experienced Software & Data Engineer to support the maintenance, enhancement, and continued development of an existing social media data exploitation platform. The program applies technical resources to accelerate the timely, reliable, and secure delivery of open-source data, information, and insights. The Software & Data Engineer will work within an established development team to enhance a service-based web application, develop data ingestion and processing capabilities, integrate external APIs, and maintain supporting database and infrastructure components. What will you do?
- Design, develop, enhance, and maintain software supporting a social media data exploitation platform.
- Develop applications and services using Python.
- Develop and maintain Python-based API integrations.
- Design, develop, and integrate APIs utilizing:
- RESTful APIs
- GraphQL
- Sockets
- Other web-service protocols
- Develop and maintain software components using Java as required.
- Develop enhancements to existing service-based web applications.
- Work with web technologies including cookies, web transactions, host-to-host communication, browser developer tools, and mobile compatibility capabilities.
- Utilize Anaconda and/or MicroMamba for Python environment and package management.
- Maintain application source code within enterprise Git repositories.
- Design, develop, and maintain SQL-based databases, including:
- PostgreSQL
- MySQL
- Develop and maintain PL/SQL scripts, including:
- Procedures
- Functions
- Exception handlers
- Triggers
- Write, optimize, and tune complex database queries.
- Work with both structured and unstructured datasets.
- Design and maintain Extract, Transform, and Load (ETL) processes.
- Develop and support data ingestion and transformation pipelines.
- Utilize Apache NiFi for data flow, ingestion, and processing.
- Work with NoSQL and big-data technologies including:
- MongoDB
- Elasticsearch
- MapReduce
- HBase
- Troubleshoot database, ingestion, transformation, and data-processing issues. Do you have what it takes?
- Active TS/SCI with Polygraph
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline preferred.
- Demonstrated professional experience developing applications with Python.
- Experience developing Python API integrations.
- Experience utilizing Anaconda and/or MicroMamba for Python package and environment management.
- Strong experience working within Linux environments.
- Experience with Bash scripting, Cron jobs, and IT automation.
- Experience developing and integrating APIs using REST, GraphQL, and/or socket-based communications.
- Professional development experience with Java.
- Experience with web application technologies and browser-based troubleshooting.
- Knowledge of SSL/TLS, certificates, and secure application communications.
- Experience designing, developing, and maintaining relational databases, including PostgreSQL and MySQL.
- Experience developing PL/SQL scripts, procedures, functions, exception handlers, and triggers.
- Experience developing and tuning complex queries against structured and unstructured datasets.
- Experience maintaining Jenkins CI/CD pipelines with automated testing and deployment.
- Experience with big-data and/or NoSQL technologies such as MongoDB, Elasticsearch, MapReduce, or HBase.
- Experience with Apache NiFi.
- Strong experience designing and supporting ETL processes and data pipelines.
- Experience maintaining and troubleshooting software, hardware, and network infrastructure.
- Experience using Git for source code management.
- Strong troubleshooting, analytical, and problem-solving abilities.
Similar jobs
- ID
Sr AWS Data Engineer (with ETL, Python, AWS Glue, Lambda, Node.js & Microservices exp)Recently posted
Info Dinamica Inc · Malvern, PA · On-site · Posted 16 Nov 2026 🇺🇸
DynamoDBMicroservicesOracle+18TechnologySalary not listed - PG

Data Engineer – Databricks, PySpark, Cloud | Hybrid - 71701Recently posted
PRIMUS Global Services Inc. · Princeton, NJ · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLScalaApache Spark+4TechnologySalary not listed - PH

Data EngineerRecently posted
Photon · Sunnyvale, CA · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLAWSETL+6TechnologySalary not listed - GE

SQL Server DBARecently posted
Genesis10 · Charlotte, NC · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLShellMicrosoft Office+3Technology$53 - $61/hr - NT
Oracle DBA with Security ClearanceRecently posted
NorthHill Technology Resources · Fairfax, VA · Hybrid · Posted 17 Nov 2026 🇺🇸
MariaDBMongoDBOracle+6TechnologySalary not listed - IT

ETL LeadRecently posted
ITSYNTAX INC · Dallas, TX · Hybrid · Posted 16 Nov 2026 🇺🇸
OraclePL/SQLSQL+6Salary not listed - VI

Sr. Data EngineerRecently posted
Visa · Foster City, California · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLScalaApache Spark+14Technology$131.9k - $204k/yr - VI

Staff Data EngineerRecently posted
Visa · Foster City, California · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLScalaApache Spark+13Technology$156.8k - $251.1k/yr - FA

Systems Engineer (Data Flow/NiFi) Level 2Recently posted Auto Apply
Fantom Corporation · Fort Meade · On-site · Posted 17 Nov 2026 🇺🇸
ApacheComplianceComputer Vision+5TechnologySalary not listed - LS

Senior Database EngineerRecently posted
London Stock Exchange Group · St Louis, MO · Hybrid · Posted 17 Nov 2026 🇺🇸
OracleShellAWS+5TechnologySalary not listed - KT

Senior Data EngineerRecently posted
Kforce Technology Staffing · Atlanta, GA · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLETLAirflow+5TechnologySalary not listed - QT

Data Engineer LeadRecently posted
QUANTUM TECHNOLOGIES LLC · United States · Hybrid · Posted 17 Nov 2026 🇺🇸
DockerSQLGit+12Technology$83/hr
