Data Engineer

Data Engineer

Brooksource

Position Overview

The Senior Data Engineer will oversee the department's data integration work, including developing data models, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis. This role will work closely and collaboratively with members of other areas to define requirements, mine and analyze data, integrate data from a variety of sources, and deploy high-quality data pipelines in support of the analytics need.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures on AWS.
• Implement data ingestion, transformation, and processing solutions using AWS services such as Redshift, S3, Glue, Athena, and Quicksight.
• Collaborate with software engineers, business analysts, and other stakeholders to refine data requirements and deliver high-quality data solutions.
• Make data available for the reporting and analytics teams.
• Produce scalable, replicable code and engineering solutions that help automate repetitive data management tasks.
• Optimize and tune data pipelines for performance, security and cost-efficiency.
• Optimize and manage data storage solutions, including data lakes and data warehouses.
• Maintain high-quality documentation of data definitions, transformations, and processes to ensure data governance and security.
• Monitor and troubleshoot data pipeline issues, ensuring timely resolution.
• Communicate effectively with business stakeholders and technical team.
• Mentor other data engineers; perform code reviews.
• Other duties as assigned
• Provide technical assistance in an on-call rotation, 24/7/365

Required Qualifications

• Experience leveraging AI tools in the software development (or product) lifecycle in order to improve quality and efficiency
• 5+ years’ experience in:
• Data Engineering, with a focus on AWS Cloud services.
• Proficiency in Amazon Web Services (AWS)
• Data Warehouse (Redshift)
• Database (RDS, DynamoDB)
• Visualization (Quicksight)
• Storage (S3)
• Other (Glue, Athena, CloudWatch)
• Strong knowledge of relational databases and SQL. Extract, Transform, and Load (ETL) data into a relational database
• Strong experience with SQL and NoSQL database technologies.
• Experience with data warehousing concepts and ETL processes.
• Experience with data modeling, data warehousing, and big data technologies.
• Experience with Encryption, Public Key Infrastructure (PKI), security best practices and compliance requirements.
• Excellent problem-solving skills and attention to detail.
• Excellent verbal and written communication skills.

Disclaimer: Brooksource, Medasource, and Calculated Hire are part of the Eight Eleven Group family of companies and operate under Eight Eleven Group, LLC. All employees receive the same benefits, policies, and terms of employment.

EEO Statement: We are committed to creating an inclusive environment for all employees and applicants. We do not discriminate on the basis of race, color, religion, creed, sex, sexual orientation, gender identity or expression, national origin, ancestry, age, disability, genetic information, marital status, military or veteran status, citizenship, pregnancy (including childbirth, lactation, and related conditions), or any other protected status in accordance with applicable federal, state, and local laws.

Benefits & Perks: Brooksource offers competitive medical, dental, vision, Health Savings Account, Dependent Care FSA, and supplemental coverage with plans that can fit each employee's needs. We offer a 401k plan that includes a company match and is fully vested after you become eligible, paid time off, sick time, and paid company holidays. We also offer an Employee Assistance Program (EAP) that provides services like virtual counseling, financial services, legal services, life coaching, etc.

Pay Disclaimer: The pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.