Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
Washington, DC, United States
Posted
19 hours ago
SQLAWSAirflowApachePython
Job Description
Job Description
- Strong hands-on experience designing and developing data and processing solutions in AWS.
- Hands-on experience working in complex AWS environments with multiple systems, processes, integrations, and dependencies.
- Strong understanding of workflow and process orchestration concepts.
- Hands-on experience designing, implementing, or optimizing automated workflows and processing pipelines.
- Hands-on experience with relevant AWS data, compute, event-driven, and orchestration services.
- Strong Python and/or SQL skills.
- Hands-on experience with distributed processing and cloud-based data architectures.
- Strong understanding of dependency management, scheduling, event-based processing, retries, error handling, and failure recovery.
- Hands-on experience implementing logging, monitoring, alerting, and operational observability.
- Ability to identify bottlenecks, unnecessary dependencies, failure points, and optimization opportunities.
- Ability to evaluate architectural alternatives and make recommendations based on operational and business requirements.
- Demonstrated ability to translate high-level business objectives into technical requirements and solution designs.
- Strong team orientation and ability to collaborate effectively across technical and business teams.
Preferred Skills
- Experience supporting large-scale enterprise AWS environments.
- Experience with AWS-native workflow and orchestration services.
- Experience with event-driven architectures.
- Experience with Apache Airflow or comparable orchestration platforms.
- Experience with distributed data-processing technologies.
- Familiarity with DevOps, CI/CD, and infrastructure automation.
- Experience with cloud performance and cost optimization.
- Strong troubleshooting and root-cause-analysis capabilities.
- Strong people skills and a collaborative, team-first mindset.
- Ability to build strong working relationships across organizational boundaries.
- Excellent written and verbal communication skills.
- Strong architectural judgment and ability to explain technical tradeoffs to non-technical stakeholders.
Job Responsibilities
- Assess existing AWS processes, workflows, integrations, schedules, and dependencies
- Partner with business and technical stakeholders to understand operational objectives, pain points, and future-state requirements
- Translate those objectives into technical orchestration and architecture requirements
- Design and recommend approaches for improving orchestration across complex AWS environments
- Identify opportunities to simplify dependencies, improve concurrency, reduce processing times, and increase reliability
- Develop and maintain cloud-based data pipelines and automated workflows
- Design appropriate monitoring, alerting, error handling, retry, and recovery capabilities
- Evaluate existing technical designs and recommend improvements based on business value, complexity, cost, scalability, and risk
- Work collaboratively with engineers, architects, application teams, infrastructure teams, and business partners
- Support teammates, share expertise, and contribute constructively to technical discussions and problem-solving
- Create clear technical documentation and architecture recommendations
- Communicate complex architecture and orchestration concepts clearly to business stakeholders and senior leadership
Similar jobs
- ES
Forward Deployed Data Engineer IV, Databricks
NewE Source
Remote🇺🇸Remote5 hours agoDockerSQLAWS+12Technology - CT
Informatica ETL/Data Engineer
NewCivilSoft Technolgies Inc
Austin, TX🇺🇸On-site19 hours agoOracleSQLETL+1Technology - EG
Data Engineer
NewEverest Global Solutions
Atlanta, GA🇺🇸Hybrid19 hours agoOracleSQLSQL Server+20Technology - IN
Azure Data Engineer
NewInnosoul inc
Raleigh, NC🇺🇸Hybrid19 hours agoAWSETLAzure+1Technology - ST
Senior Databricks Data Engineer-Parsippany-Troy Hills, NJ, USA
NewStoneGate-Technologies LLC
Parsippany-Troy Hills, NJ🇺🇸Hybrid19 hours agoSQLETLDatabricks+1Technology - MG
Principal Data Engineer
NewMedical Guardian
Philadelphia, Pennsylvania🇺🇸Hybrid1 hour agoMicroservicesSQLETL+4Technology