TTG-359 - Apache Spark Data Engineer (Python/AWS) - $331,850 Tot with Security Clearance

Summary TTG Solutions is seeking a skilled Data Engineer to build and support innovative data-processing solutions using modern technologies. We are looking for someone with a deep understanding of cloud services and data pipelines to process and analyze complex datasets. Description The Data Engineer will be responsible for building and managing robust data pipelines, processing and analyzing data across multiple formats, and developing validated, unit-tested solutions. You will utilize technologies such as Python, AWS, Apache Spark, relational databases, and Linux for day-to-day tasks.

A strong focus on writing and validating unit tests, as well as SQL queries, is essential. Experience Level
Subject Matter Expert Normally requires at least sixteen (16) years of experience specific to the skill or occupation. For specific computer languages, systems or technologies, expertise with the subject matter or technology outweighs the number of years of experience.

Requirements: 16 yrs+

Required Skills

• Building and managing data pipelines
• Python
• AWS cloud services
• Apache Spark data processing
• RDBMS technologies (PostgreSQL, Oracle, MySQL)
• SQL queries
• Linux and shell scripting
• Analyzing data in formats including CSV, XML, JSON, Avro, and Parquet
• Writing and validating unit testsOptional Skills
• NiFi
• Apache Airflow or equivalent data-pipeline orchestration tools
• Java or Scala
• Administering EMR/Spark clusters
• Spark job performance tuning
• Developing cloud-based security solutions
• Configuration-management processes for reviewing and deploying codeClearance This position requires an active TS/SCI clearance with Polygraph..comp-table{border-collapse:collapse;width:100%;margin-bottom:20px}.comp-table th,.comp-table td{border:1px solid black;padding:8px;text-align:left}.comp-table th{background-color:#f2f2f2;font-weight:bold}BenefitsBenefitDetails

Base Salary $200,000 - $241,000 PTO 30 days annual PTO, which includes holidays. Retirement 15% company retirement contribution. No match required. Vesting period is 50% per year over 2 years. Paid Benefits Company pays all insurance expenses up to 8% of base pay. If your insurance expenses are less that that, we bonus the difference to you. Annual Bonuses 3% to 5% annual bonuses. Cell Phone Stipend $100 monthly phone expense reimbursement. Training Budget 3 paid training days + $2,500 training budget New Hire Bonus $5,000 new hire bonus Total Compensation Total compensation is the total combination of salary, benefits, retirement, bonuses, etc... and it is calculated using the following formula: Total Compensation = Base Salary + Benefits Budget + Retirement + Bonus + Training Budget + Phone Stipend Although each company has their own blend of salary and benefits, comparing total compensation is typcially the best way to compare the financial impact of each position. At TTG Solutions, we work hard to ensure our particular blend always meets or exceeds the market average. Total Compensation = $331,850 .total-comp-table{border-collapse:collapse;width:100%;margin-bottom:20px;font-family:sans-serif;font-size:14px}.total-comp-table th,.total-comp-table td{border:1px solid #ccc;padding:12px 16px;text-align:left}.total-comp-table thead{background-color:#f9f9f9;font-weight:bold}.total-comp-table td:nth-child(2),.total-comp-table th:nth-child(2){text-align:right}.total-comp-table tr:nth-child(even){background-color:#f6f6f6}BenefitValueDetails
Base Salary $241,000 Base salary for position. Retirement $36,150 15% company retirement contribution. No match required. Vesting period is 50% per year over 2 years. Benefits Budget $48,200 20% company paid Individual Benefits Account (12% for 30-days PTO, 8% for Insurances). If your insurance or PTO expenses are less than this, we bonus the difference to you. Annual Bonus $12,050 Annual bonus, 3% to 5% on average. Training Budget $2,500 Annual training budget. Training Hours $2,800 3 paid days for training. Phone Stipend $1,200 $100 monthly cell phone stipend.