Senior Data Platform Engineer

About Us:
Jarvis is driven by a bold vision to transform the professional services landscape by setting a new standard for innovation, empowerment, and impactful solutions in data, AI, and technology. Our diverse team comprises expert advisors and forward-thinking technologists who work tirelessly to unlock the full potential of businesses, ensuring the consistent delivery of exceptional results. The world of technology is rapidly evolving through innovation and cutting-edge technologies. As we move into the future, we believe in keeping up with relevant technologies and building that future ourselves. Our greatest assets are our people, and at Jarvis, we value imagination and curiosity as much as capability and skill.

Senior Platform Engineer – Data Platform Engineering Practice


Role Overview
Jarvis Consulting Group’s Technology Advisory Services division is looking for a highly experienced Senior Platform Engineer to join our Data Platform Engineering Practice and support a mission-critical enterprise cloud data platform.
This role is designed for a senior technical professional who enjoys solving complex engineering challenges, providing technical leadership, and helping organizations maximize the value of modern cloud data technologies.
You will work with a sophisticated Azure and Databricks environment supporting enterprise data, analytics, and AI capabilities. As a senior member of the team, you will act as a trusted technical resource, helping drive platform stability, scalability, automation, and continuous improvement.

Day-to-Day Responsibilities
Senior Technical Platform Ownership

• Serve as a senior technical resource responsible for supporting and improving enterprise data platform capabilities
• Provide technical guidance on Azure and Databricks architecture, design decisions, and operational practices
• Lead troubleshooting efforts for complex platform and production issues
• Perform detailed technical analysis and drive issues through resolution
• Help establish best practices for platform engineering and operational excellence

Azure & Databricks Engineering

• Design, support, and optimize Azure-based data platform services
• Troubleshoot Databricks clusters, workflows, pipelines, and platform configurations
• Support platform reliability, monitoring, and performance improvements
• Work with engineering teams to resolve technical challenges across the data ecosystem
• Ensure platform solutions are secure, scalable, and maintainable

Technical Leadership & Collaboration

• Act as a technical representative for the platform engineering team
• Mentor and support other engineers through knowledge sharing
• Participate in technical discussions, architecture reviews, and solution planning
• Collaborate with engineering, data, and business teams to deliver high-quality solutions

Automation & Continuous Improvement

• Identify opportunities to automate operational processes
• Build solutions using scripting, GitHub Actions, and cloud automation tools
• Improve platform processes, documentation, and developer experience
• Drive initiatives that improve efficiency and reduce operational complexity

Must-Have Skills & Experience
Azure Cloud Engineering
Strong experience with:

• Azure cloud architecture and enterprise platform operations
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS)
• Azure Function Apps
• Azure Monitoring and diagnostics
• Azure storage services and cloud-native capabilities
• Troubleshooting complex Azure environments

Azure Databricks Expertise
Strong hands-on experience with:

• Azure Databricks administration and engineering
• Unity Catalog
• Databricks Jobs and Workflows
• Databricks Pipelines
• Cluster management and optimization
• Databricks security and access management
• Production support of Databricks environments

Data Platform Engineering
Experience with:

• Enterprise-scale data platforms
• Data ingestion and orchestration
• Data pipeline operations
• Cloud-native data architecture
• Platform reliability engineering
• Production incident management and troubleshooting

Automation & Development
Experience with:

• Python scripting and automation
• GitHub Actions
• CI/CD pipelines
• Platform tooling and process automation

Cloud Integration & Security
Understanding of:

• API integrations
• Authentication and authorization protocols
• Identity management
• Secure cloud platform design principles

Nice-to-Have / Preferred Skills

• Databricks Professional Certification (strong preference)
• Databricks Certified Data Engineer Professional certification
• Azure Kubernetes Service (AKS)
• Azure API Management
• Azure AI Services
• Databricks Asset Bundles
• Infrastructure as Code (Terraform, ARM, Bicep)
• Azure DevOps
• Cloud governance and enterprise architecture experience
• Experience leading technical initiatives or mentoring engineers

Soft Skills & Personality
The ideal candidate is a senior engineer who brings both technical excellence and strong professional maturity.
We are looking for someone who:

• Has deep technical curiosity and enjoys solving challenging problems
• Takes ownership of complex issues and drives them to completion
• Demonstrates strong analytical and troubleshooting abilities
• Communicates clearly and confidently with stakeholders
• Is comfortable challenging ideas while remaining collaborative
• Values accuracy and quality over simply providing quick answers
• Is transparent about knowledge gaps and approaches problems thoughtfully
• Enjoys mentoring others and sharing expertise
• Can operate effectively in a highly collaborative enterprise environment

Experience Level

• Typically 6+ years of experience in cloud engineering, data platform engineering, Azure engineering, or similar roles
• Strong preference for candidates with significant hands-on experience supporting enterprise Azure and Databricks environments
• Candidates should demonstrate the ability to independently contribute with minimal ramp-up time

We are open to hiring on either a contract or permanent basis.  Contract rates to $100/hr if incorporated, permanent salary to $160k base plus bonus and unlimited PTO.