TTG-376 - Big Data & ETL Engineer (PySpark, Python, SQL) - $348, with Security Clearance

Summary TTG Solutions is seeking an experienced Data Engineer to support the development and enhancement of data systems and applications in diverse cloud computing environments. We require a professional who is adept in managing and expanding data processing capabilities and is proficient in leveraging cloud-based analytics. Description The selected candidate will support the development of new system capabilities, maintain and enhance data pipelines, and improve applications within cloud environments.

Key responsibilities include data mapping, extraction, transformation, and loading (ETL), analytic report building using tools like CloudWatch and Kibana, and processing OS and Data Logs into dashboards. The role involves regular interaction with customers and integration partners to clarify objectives and contribute to Agile development processes by defining tasks, scoping, and reviewing. Experience Level
Subject Matter Expert Normally requires at least sixteen (16) years of experience specific to the skill or occupation.

For specific computer languages, systems or technologies, expertise with the subject matter or technology outweighs the number of years of experience.

Requirements: 16 yrs+

Required Skills

• Experience with big data processing technologies such as Spark, Pyspark, and Python
• Proficiency in data mapping, extraction, transformation, and loading (ETL)
• Experience building analytic reports with tools like CloudWatch and Kibana
• Ability to process and convert OS and Data Logs into reports and metrics dashboards
• Proficiency with Regular Expressions (RegEx)
• Experience with SQL, MySQL, PostgreSQL
• Proficiency in processing data file types such as XML and JSON
• Experience with IDEs and Data Modeling using tools like Notebooks and Visual Studio
• Experience performing data quality analysis and ETL documentation
• Ability to interface with customers and integration partners
• Support Agile development through task definition, scoping, and reviewOptional Skills
• Experience deploying on the Databricks unified analytics platform
• Experience with Elastic Map Reduce for big data workloads
• Proficiency in joining complex data sets using Spark
• Experience in tuning Spark streaming and batch jobs
• Proficiency in deploying complex, notebook-based pipelines
• Experience with Python data analysis libraries like Pandas
• Familiarity with cloud services such as Lambda, SNS/SQS, or EC2
• Experience with DevOps tools including Cloudwatch, Lambda, SQS, Dynamo, and RDS
• Experience with the ElasticSearch/Logstash/Kibana (ELK stack)Clearance This position requires an active TS/SCI clearance with Polygraph..comp-table { border-collapse: collapse; width: 100%; margin-bottom: 20px; } .comp-table th, .comp-table td { border: 1px solid black; padding: 8px; text-align: left; } .comp-table th { background-color: #f2f2f2; font-weight: bold; } .comp-table tr:nth-child(even) { background-color: #f9f9f9; }BenefitsBenefitDetails

Base Salary $209,000 - $253,000 PTO 30 days annual PTO, which includes holidays. Retirement 15% company retirement contribution. No match required. Vesting period is 50% per year over 2 years. Paid Benefits Company pays all insurance expenses up to 8% of base pay. If your insurance expenses are less that that, we bonus the difference to you. Annual Bonuses 3% to 5% annual bonuses. Cell Phone Stipend $100 monthly phone expense reimbursement. Training Budget 3 paid training days + $2,500 training budget New Hire Bonus $5,000 new hire bonus Total Compensation Total compensation is the total combination of salary, benefits, retirement, bonuses, etc... and it is calculated using the following formula: Total Compensation = Base Salary + Benefits Budget + Retirement + Bonus + Training Budget + Phone Stipend Although each company has their own blend of salary and benefits, comparing total compensation is typcially the best way to compare the financial impact of each position. At TTG Solutions, we work hard to ensure our particular blend always meets or exceeds the market average. Total Compensation = $348,150 .total-comp-table{border-collapse:collapse;width:100%;margin-bottom:20px;font-family:sans-serif;font-size:14px}.total-comp-table th,.total-comp-table td{border:1px solid #ccc;padding:12px 16px;text-align:left}.total-comp-table thead{background-color:#f9f9f9;font-weight:bold}.total-comp-table td:nth-child(2),.total-comp-table th:nth-child(2){text-align:right}.total-comp-table tr:nth-child(even){background-color:#f6f6f6}BenefitValueDetails
Base Salary $253,000 Base salary for position. Retirement $37,950 15% company retirement contribution. No match required. Vesting period is 50% per year over 2 years. Benefits Budget $50,600 20% company paid Individual Benefits Account (12% for 30-days PTO, 8% for Insurances). If your insurance or PTO expenses are less than this, we bonus the difference to you. Annual Bonus $12,650 Annual bonus, 3% to 5% on average. Training Budget $2,500 Annual training budget. Training Hours $2,900 3 paid days for training. Phone Stipend $1,200 $100 monthly cell phone stipend.