Quick overview
Job description
As a Senior BI Data Engineer, you will design, build, and optimize enterprise-scale data solutions that power analytics and business decision-making across Boston Beer. You will work hands-on with Databricks, Azure data services, and modern data engineering practices to deliver reliable, scalable, and high-performing data products. In this role, you'll partner with stakeholders across multiple business functions while helping drive platform modernization, engineering excellence, and technical innovation.
- Design, build, and support scalable Databricks Lakehouse data pipelines using Apache Spark, Delta Lake, Structured Query Language (SQL), and Python.
- Lead technical design and delivery for complex data initiatives that span multiple systems, platforms, and business functions.
- Diagnose production issues, perform root cause analysis, evaluate technical alternatives, and implement solutions that improve reliability, scalability, and maintainability.
- Develop reusable frameworks and engineering practices for data ingestion, transformation, orchestration, testing, monitoring, data quality, and production support.
- Administer and support Databricks platform capabilities, including workspace configuration, Unity Catalog, permissions management, and data governance.
- Design and manage production workflows, including scheduling, dependency management, monitoring, alerting, and failure recovery.
- Implement continuous integration and continuous deployment (CI/CD) processes using Azure DevOps, Git-based development workflows, and Databricks Asset Bundles.
- Collaborate with business stakeholders, analytics teams, and technology partners to define requirements and deliver impactful data solutions.
- Optimize data pipelines, compute resources, and storage for performance, observability, reliability, and cost efficiency while supporting modernization of legacy SQL Server solutions.
- Mentor engineers, conduct code and design reviews, and contribute to continuous improvements in engineering standards and practices.
- Work in a standard office environment with occasional travel as needed to support business objectives and team collaboration.
- Bachelor's degree in Computer Science, a closely related field, or equivalent practical experience.
- 7+ years of experience in data engineering, data warehousing, data integration, analytics engineering, or related technology roles.
- 3+ years of hands-on Databricks development experience supporting production environments.
- Strong expertise with Databricks Lakehouse, Apache Spark, Delta Lake, Databricks Workflows, Unity Catalog, and distributed data processing.
- Experience working with Microsoft Azure data services, including Azure Data Factory, Azure Data Lake Storage, and Azure Key Vault.
- Advanced SQL and Python skills with experience building, operating, and optimizing complex ETL/ELT pipelines and analytical data models.
- Experience with modern DevOps and data engineering practices, including Git-based development, automated testing, CI/CD, orchestration, monitoring, security, governance, and production support.
- Demonstrated ability to lead technical solution design, evaluate technical trade-offs, and independently deliver complex data initiatives.
- Strong communication and collaboration skills with experience providing technical guidance to engineering teams.
- Experience with advanced Databricks capabilities, including Databricks Asset Bundles, workspace administration, platform configuration, and governance.
- Experience with Power BI semantic modeling, reporting enablement, and analytics consumption patterns.
- Experience modernizing legacy SQL Server data solutions to cloud-based platforms.
- Familiarity with artificial intelligence (AI), machine learning (ML), feature engineering, or model-ready data products.
- Knowledge of SAP, Salesforce, Supply Chain, Manufacturing, or consumer packaged goods business processes.
Level: L6
- Tuition reimbursement
- Fertility/adoption support
- Free financial coaching
- Health & wellness program and discounts
- Professional development & training
- Free beer!
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- NA

Senior Bioinformatics & Genomics Data System EngineerRecently posted Auto Apply
Natera · San Carlos · Hybrid · Posted 16 Nov 2026 🇺🇸
MySQLGitAWS+6Technology$125.8k/yr - NA

Senior Bioinformatics & Genomics Data System EngineerRecently posted Auto Apply
Natera · US Remote · Remote · Posted 16 Nov 2026 🇺🇸
MySQLGitAWS+6Technology$113.6k - $142k/yr - LI

Data & AI Platform, Intern - Summer 2027Recently posted Auto Apply
Lightmatter · Boston · Hybrid · Posted 16 Nov 2026 🇺🇸
SQLGitSnowflake+2$50 - $55/hr - AF

Staff Data Engineer, AnalyticsRecently posted Auto Apply
Afresh · Remote · Remote · Posted 16 Nov 2026 🇺🇸
SQLSnowflakeAirflow+4TechnologySalary not listed - SU

Senior Data EngineerRecently posted Auto Apply
Surveymonkey · US - Remote · Remote · Posted 16 Nov 2026 🇺🇸
SQLETLSnowflake+4Technology$194.8k - $259.2k/yr - FR

Data EngineerRecently posted Auto Apply
First Resonance · Los Angeles · On-site · Posted 16 Nov 2026 🇺🇸
OnboardingNext.jsSQL+18TechnologySalary not listed - ST
Data Engineer - HealthcareRecently posted Auto Apply
Sand Tech Holdings Limited · United States · Hybrid · Posted 16 Nov 2026 🇺🇸
SQLApache SparkAWS+8TechnologySalary not listed - OR
Data Engineer & Application Development (TS/SCI w/ Poly) Auto Apply
Orbis · McLean · Hybrid · Posted 3 Nov 2026 🇺🇸
SQLGitData Pipeline+7TechnologySalary not listed - WE

Staff Data Engineer Auto Apply
Webflow · United States · Remote · Posted 20 Oct 2026 🇺🇸
SQLAirflowEMR+5Technology$212.5k - $255k/yr - OV

Staff Data Engineer Auto Apply
Overstory · United States · Remote 🇺🇸
AirflowBigQueryGoogle Cloud+2TechnologySalary not listed - LT
Staff ML Data Engineer Auto Apply
Liveview Technologies · Seattle · Hybrid 🇺🇸
ETLMLOpsCompliance+5Technology$171.9k - $221k/yr - F7
Staff Engineer, Data Platform (R5659) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · San Diego · Hybrid · Posted 2 Nov 2026 🇺🇸
Talent AcquisitionData PipelinePython+3TechnologySalary not listed
