Data Engineer(ETL) W2 Citizens Only

The Expertise You Have

Bachelor’s degree in computer science, Information Systems, or a related field

Proven track record in data engineering

10+ years’ experience developing Spark Services for Data movement.

Schedule, Monitor and debug ETL Spark Batch.

Hands on Experience with Java clients for consuming REST and SOAP APIs and Scala spark batch application.

Develop, Test, Deploy and maintain ETL Batch Jobs using Apache Spark/EMR Jobs.

Utilizing Apache Spark cluster-computing framework to process big data and write to No-SQL Database ex Cassandra or Yugabyte.

Experience with cloud-based data warehousing and data lake solutions such as Snowflake

Experience with data storage and data management for large datasets like parquet, HDF5, etc.

Proven experience in building and deploying software solutions utilizing public cloud provider services like AWS.

The Skills You Bring

Champions innovative technology solutions to resolve sophisticated business problems

Works across groups to find opportunities for organization-wide technology initiatives

Brings external information, ideas, and expertise back to the team

Good understanding of the software development process including analysis, design, coding, system and user testing, problem resolution and planning

Identify creative ways to drive desired outcomes and promote culture of innovation by setting examples.

Collaborate with peers through code reviews, pair programming or interactive discussions daily.

Ability to work across multiple squads and adaptable to change.

Embrace customer-first mentality and enjoy developing user-friendly internet facing web applications that tackle real life problems.

Have a passion for following outstanding software engineering practices and always looking to improve your engineering skills and industry knowledge.

Bring a data-driven & collaborative approach to decision making, both in day-to-day work and in making strategic trade-offs.

Skills

ETL, Scala, Spark, AWS, Cassandra, Snowflake, Control M

Top Skills Details

ETL,Scala,Spark,AWS,Cassandra,Snowflake,Control M