Lead DataOps Engineer

Job Title:- Lead DataOps Engineer

Location:- Short Hills, New Jersey Hybrid - Short Hills, New Jersey is highly preferred; Charlotte, North Carolina is an option

Duration:- 6 month

Duration: 6-month C2H

Interview Process: 2-3 interviews (most likely all video but the final could be onsite if their local)

seeking an energetic and collaborative Data Engineering Team lead to work on data, analytics and DataOps projects supporting the Information Management group. This group is responsible for technology support of all Data Engineering, Analytics and Reporting for specific business areas. This includes Data Engineering services, Enterprise reporting support and ML Ops Engineering operations for these groups. An ideal candidate will leverage their technical proficiency and leadership competencies to drive the delivery of key objectives.

Responsibilities

Lead a high performing team in the delivery of key components and business deliverables.

Lead the design and implementation of DataOps frameworks, standards, and best practices across the organization.

Partner with Data Architecture, Analytics, AI/ML, and Platform teams to operationalize data products end to end.

Establish operational expectations for data products/data contracts, including reliability targets, change management, and consistency of consumption for analytics and AI use cases.

Drive adoption of automation, orchestration, and observability capabilities for data pipelines.

Ensure both on-time successful delivery, and the technical and architectural quality of the solutions.

Collaborate with individuals from all areas of the business and IT organizations to develop accurate business requirements and design architectural solutions.

Resolve and escalate technical and project delivery issues as needed.

Drive process improvements within the team and across the department to improve efficiency and quality.

Work directly with the architecture group to coordinate new design patterns and technology.

Assist in prioritizing new development projects, enhancement projects for existing systems, and system maintenance requests.

Act as a key contributor in planning and estimation of projects

Support development of talent within the organization through coaching and mentoring of team members.

Ensure design, code, and test plan reviews are conducted as appropriate.

Qualifications

Required:

o Proven history of owning and taking accountability for leading others to complete complex deliverables.

o Excellent communication skills

o 8+ years of experience in data engineering, analytics engineering, or platform engineering.

o Strong experience with cloud data platforms (Azure, AWS, or Google Cloud Platform).

o Experience with Databricks, or modern lakehouse architecture.

o Proficient with Data pipelines and orchestration (e.g., Airflow, ADF, Dagster, dbt)

o Proficient with CI/CD tools (Azure DevOps, GitHub Actions, GitLab, etc.)

o Proficient in Data modeling, PySpark and SQL

o Proficient in modern data architecture

o Experience with DataOps or other automation frameworks.

Preferred:

o SAFe agile work experience or similar agile process

o College degree in Computer Science or Management Information systems

o Familiarity with streaming platforms (Event Hubs, Kafka, Kinesis).

o Experience supporting machine learning or AI workloads in production.

o Property Casualty Insurance experience

o Experience working within Azure ecosystem

Navya Gupta Sr. IT Technical Recruiter

Email: Gtalk: Phone: +1 Linkedin id: Address: 505 Knolle Court, Saint Augustine| FL 32092