Quick overview
Job description
Shift: Remote role
Key Responsibilities
- Design, develop, and maintain scalable ETL pipelines using AWS Glue, EMR (PySpark), and Lambda functions
- Implement real-time data streaming solutions using Confluent Kafka with source and sink connectors
- Develop and optimize PySpark jobs on EMR clusters for large-scale data transformations
- Build serverless data processing workflows using AWS Lambda
- Design and optimize queries in AWS Athena for analytical workloads
- Manage data warehouse solutions in AWS Redshift including data modeling and performance tuning
- Implement monitoring and alerting using CloudWatch for data pipeline health and performance
- Provision and manage AWS infrastructure using Terraform
- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements
- Implement data governance and security best practices using Lake Formation, IAM, and KMS
- Python: Advanced proficiency in Python 3.8+ for data processing, scripting, and automation
- PySpark: Extensive experience with PySpark for large-scale data processing and transformations on EMR clusters
- AWS Lambda: Hands-on experience building serverless functions for data processing and orchestration
- AWS Glue: Expertise in AWS Glue for ETL jobs, Data Catalog management.
- AWS Athena: Experience with Athena for SQL-based data analysis and querying data lakes
- AWS EMR: Strong experience with EMR for running Spark jobs, EMR Notebooks, and cluster management
- AWSRedshift: Knowledge of Redshift for data warehousing, query optimization, and integration with data lakes
- Kafka: Experience with Confluent Kafka for real-time data streaming, including Schema Registry, source/sink connectors, and producers/consumers
- AWS S3: Deep understanding of S3 for data lake architecture, bucket policies, and data organization (raw, curated layers)
- CloudWatch: Proficiency in CloudWatch for logging, monitoring, and alerting on data pipelines
- Terraform: Experience with Infrastructure as Code using Terraform for provisioning AWS resources
- Knowledge of AWS EventBridge and Step Functions for workflow orchestration
- Familiarity with EMR runtime roles and execution roles for secure data access
- Experience with DynamoDB for NoSQL data storage
- Knowledge of API Gateway for building data APIs
- Bachelor's degree in Computer Science, Data Engineering, Information Technology, or related field
- Strong understanding of distributed computing and big data processing frameworks
- Experience with Agile development methodologies
- Excellent problem-solving and analytical skills
- Strong communication and collaboration abilities
- EMR Notebooks or Jupyter for interactive development
- VS Code or similar IDE for Python development
- Git for version control
- AWS CLI and boto3 for AWS service interaction
- Terraform for infrastructure provisioning
- DBeaver, Data Studio for database management
About US Tech Solutions:
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit
US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
By applying, you acknowledge that AI-assisted tools may be used during hiring.
#LI-AS140
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- PE

Mid Data Engineer - Current Operations Picture (COP)/Current Int with Security ClearanceRecently posted
Prescient Edge · Huntsville, AL · Hybrid · Posted 17 Nov 2026 🇺🇸
TechnologySalary not listed - BA

Data Engineer, Mid with Security ClearanceRecently posted
Booz Allen Hamilton · Alexandria, VA · On-site · Posted 17 Nov 2026 🇺🇸
ETLIoTPython+3Technology$62k - $141k/yr - CA

Data Engineer with Security Clearance
CACI · Arlington, VA · Hybrid · Posted 2 Nov 2026 🇺🇸
SQLGitApache Spark+9Technology$103.8k - $218.1k/yr - FO

Data Engineer IIRecently posted
FedEx Office · Plano, TX · Hybrid · Posted 18 Nov 2026 🇺🇸
MongoDBMySQLSQL+21Technology$9.0k/mo - SS
Data engineer with cybersecurityRecently posted
Sharpedge Solutions · Bellevue, WA · Hybrid · Posted 15 Nov 2026 🇺🇸
SnowflakeSplunkData Pipeline+7TechnologySalary not listed - IC

Sr Data EngineerRecently posted
Infinite Computer Solutions (ICS) · Atlanta, GA · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLAWSETL+2TechnologySalary not listed - FS

Data EngineerRecently posted
FlairTech Solutions · United States · Remote · Posted 17 Nov 2026 🇺🇸
SQLAWSTableau+7TechnologySalary not listed - AT

Sr. Oracle DBARecently posted
Acadia Technologies, Inc. · Atlanta, GA · Hybrid · Posted 17 Nov 2026 🇺🇸
OraclePL/SQLSQL+2TechnologySalary not listed - RY
Lead Data Engineer / ArchitectRecently posted
RyanBPM · Cary, NC · On-site · Posted 17 Nov 2026 🇺🇸
Neo4jSQLScala+20TechnologySalary not listed - ME

Customer Data Platform (CDP) ManagerRecently posted Auto Apply
Monster Energy · USA - Corona · Hybrid · Posted 18 Nov 2026 🇺🇸
SQLLookerCRM+5$116.3k/yr - SA

Data Engineer with Security ClearanceRecently posted
Strategic Alliance Business Group LLC · Peterson SFB, CO · Hybrid · Posted 17 Nov 2026 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft PowerPoint+4Technology$95k - $135k/yr - SA

Senior Data Engineer with Security ClearanceRecently posted
Strategic Alliance Business Group LLC · Peterson SFB, CO · Hybrid · Posted 17 Nov 2026 🇺🇸
Microsoft ExcelMicrosoft OfficeMicrosoft PowerPoint+3Technology$104k - $147k/yr