Sr. Data Engineer

Bachelor s degree in Computer Science, or related technical discipline

10+ years of experience in large-scale software development, 5+ years of big data experience

Programming experience, Python or Scala preferred.

Experience working with Hadoop and related processing frameworks such as Spark, Hive, etc.

Experience with messaging/streaming/complex event processing tooling and frameworks

Experience with data warehousing concepts, SQL and SQL Analytical functions

Experience with workflow orchestration tools like Apache Airflow

Experience with source code control tools like Github or Bitbucket

Ability to communicate effectively, both verbally and written, with team members

Interest in and ability to quickly pick up new languages, technologies, and frameworks

Experience in Agile/Scrum application development

Experience with Java

Experience working in a public cloud environment, particularly AWS, databricks

Experience with cloud warehouse tools like Snowflake

Experience working with NoSQL data stores such as HBase, DynamoDB, etc.

Experience building RESTful API s to enable data consumption

Experience with build tools such as Terraform or CloudFormation and automation tools such as Jenkins or Circle CI

Experience with practices like Continuous Development, Continuous Integration and Automated Testing