Data Engineer - Databricks

We are seeking a Data Engineer with experience in projects emphasizing complex data solutions.

This person will be responsible for supporting the continued performance, reliability, and availability of two critical applications, which are essential to our clients supply chain and planning operations. This Data Engineer will help support Databricks activities that minimize disruptions, maintain stable daily operations, and deliver approved fixes or enhancements as required. The Data Engineer will assist with requirements analysis, design/develop process flow, and unit/integration testing, to deliver complex data products.

• Work with the various technology teams and operational stakeholders to support and enhance two applications
• Lead the Queue Management System to ensure timely processing, issue resolution, and continuity of business operations within the applications.
• Design and develop database objects, tables, stored procedures, views, etc.
• Design and develop ETL Processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases
• Understands the concept of Data Marts and Data lakes and experience with migrating legacy systems to data marts/lake
• Uses additional cloud technologies (e.g., understands concept of Cloud services like Azure SQL server)
• Maintain comprehensive project documentation

· Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement.

· Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members.

• Manage multiple projects, responsibilities and competing priorities.

Experience Needed:

• Programming languages, frameworks, and file formats such as: Python, SQL, PLSQL, DBT
• Database platforms such as: Oracle, SQL Server, MySQL
• Big data concepts and technologies such as Synapse & Databricks
• AWS and Azure cloud computing