Why this role stands out
You can significantly impact a leading insurer's data strategy by architecting and developing scalable data pipelines within a medallion architecture, leveraging cutting-edge technologies like Spark and DBT. This remote role offers a fantastic opportunity to grow your expertise in data engineering and contribute to a reputable organization. If you are a skilled Elasticsearch Data Engineer with experience in Java Spring Boot and IBM ACE, this role is an excellent fit for your career advancement.
Quick overview
Job description
Our Client is one of the United States’ largest insurers, providing a wide range of insurance and financial services products with gross written premiums well over US$25 Billion (P&C). They proudly serve more than 10 million U.S. households with more than 19 million individual policies across all 50 states through the efforts of over 48,000 exclusive and independent agents and nearly 18,500 employees. Finally, our Client is part of one the largest Insurance Groups in the world.
The Data Engineer will architect, develop, and maintain scalable data pipelines within a medallion architecture (bronze, silver/base vault, business vault, gold layers). This role is key in enabling high-quality, business-ready datasets by leveraging modern data engineering technologies and orchestration practices.
Role Responsibilities:
• Design, build, and manage end-to-end data pipelines across the medallion architecture—specifically the bronze, silver (base vault with DBT and orchestration tools, business vault), and gold layers.
• Ingest and process raw data using Spark and Amazon EMR for scalable, distributed computation.
• Develop and automate data transformations for the base vault using DBT (Data Build Tool) to standardize and model data efficiently.
- At least 5 years of experience as an Elasticsearch Data Engineer - ELK (Elasticsearch, Logstash, and Kibana) stack Expert knowledge)
- Java Spring Boot
- IBM ACE Programming
- BS in Computer Science, Data Engineering (Big Data, AWS certification), Data Modeling or similar
- Full English Fluency
Skills & Competencies
- Strong understanding of data modeling, governance, and best practices in modern data architectures.
- Excellent analytical, problem-solving, and communication skills.
Software / Tool Skills
- Elasticsearch - cluster optimization, query development, data modeling, performance tuning & administration (4-6 Years) (Must)
- Deep experience with Spark, Python and ETLs and Amazon EMR (Must)
- Hands-on experience with DBT for data transformation and modeling.
- Apache Airflow, AWS Step Functions, or similar. (Must)
- Expert knowledge of Amazon S3 and Apache Iceberg for data storage and management.
- Experience with Kubernetes for container orchestration.
- Experience with Dremio, Looker, or equivalent business view/semantic layer technologies
- AWS Cloud – Intermediate, AWS Lambda (Must) , Step Functions, IAM, SNS, API Gateway, VPC, Transit Gateway, Intermediate (3-4 Years)
- JSON - Intermediate (4-6 Years)
- Jenkins – Data Pipeline Intermediate (4-6 Years) PLUS
- CloudWatch - Intermediate (4-6 Years) PLUS
This position comes with competitive compensation and benefits package:
- Competitive salary and performance-based bonuses
- Comprehensive benefits package
- Career development and training opportunities
- Flexible work arrangements (remote and/or office-based)
- Dynamic and inclusive work culture within a globally renowned group
- Private Health Insurance
- Pension Plan
- Paid Time Off
- Training & Development
About Capgemini
Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 340,000 team members in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group €22.5 billion in revenues in 2023.
Similar jobs
- CE
Senior Data Engineer (Java expertise required) Auto Apply
Cermati.com · Bengaluru, KA · On-site 🇮🇳
Data AnalysisTechnologySalary not listed - CE
Lead Data Engineer (Java expertise required) Auto Apply
Cermati.com · Bengaluru, KA · On-site 🇮🇳
Project ManagementData AnalysisTechnologySalary not listed - NI
Data Engineer (Python, Java, SQL, PL/SQL)Recently posted Auto Apply
NielsenIQ · Chennai, TN · On-site 🇮🇳
SAFeContinuous ImprovementRoot Cause Analysis+1TechnologySalary not listed - CG
IT Engineer - Data LakehouseRecently posted Auto Apply
Continental Group Sector ContiTech · Bangalore, Karnataka · Hybrid 🇮🇳
SAFeScalaGit+15TechnologySalary not listed - CO

Data EngineerRecently posted Auto Apply
Commvault · Bengaluru · Hybrid 🇮🇳
SQLGitBash+11TechnologySalary not listed - CA

Lead Engineer Technology (Data Engineering) (India)Recently posted Auto Apply
Code and Theory · Bengaluru · Hybrid 🇮🇳
SQLSnowflakeAirflow+12Salary not listed - CA

Director, Technology (Data Engineering) (India)Recently posted Auto Apply
Code and Theory · Bengaluru · Hybrid 🇮🇳
SQLComplianceGA4+4Salary not listed - BG
Sr.Data Engineer Auto Apply
Bosch Group · bengaluru · On-site 🇮🇳
SQLETLDatabricks+5TechnologySalary not listed - FF
Delivery Data Manager (12 Month Contract)Recently posted Auto Apply
FE fundinfo · Chennai, Tamil Nadu · Hybrid 🇮🇳
Stakeholder ManagementMicrosoft ExcelLogisticsSalary not listed - MI
Senior DataOps Engineer (AWS & Security Focused)Recently posted Auto Apply
Mindera · Chennai, Tamil Nadu · Remote 🇮🇳
DockerSQLGit+19TechnologySalary not listed - MO

Senior Data Engineer - FreelanceRecently posted Auto Apply
Monks · India · Hybrid 🇮🇳
Stakeholder ManagementSQLETL+17TechnologySalary not listed - AN

Engineer III - Data EngineerRecently posted Auto Apply
Anaplan · Gurugram · Hybrid 🇮🇳
DockerDynamoDBGCP+17TechnologySalary not listed