Google Cloud Platform Data EngineerJob Description
Quick Overview
Job Description
Design and develop big data applications using the latest open source technologies.
• Desired working in offshore model and Managed outcome
• Develop logical and physical data models for big data platforms.
• Automate workflows using Apache Airflow.
• Create data pipelines using Apache Hive, Apache Spark, Scala, Apache Kafka.
• Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
• Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
• Mentor junior engineers on the team
• Lead daily standups and design reviews
• Groom and prioritize backlog using JIRA
• Act as the point of contact for your assigned business domain
Requirements:
• 8+ years of hands-on experience with developing data warehouse solutions and data products.
• 4+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive,Scala, Airflow or a workflow orchestration solution are required
. 4 + years of experience in Google Cloud Platform,GCS Data proc, BIG Query
• 2+ years of hands-on experience in modeling(Erwin) and designing schema for data lakes or for RDBMS platforms.
• Experience with programming languages: Python, Java, Scala, etc.
• Experience with scripting languages: Perl, Shell, etc.
• Practice working with, processing, and managing large data sets (multi TB/PB scale).
• Exposure to test driven development and automated testing frameworks.
• Background in Scrum/Agile development methodologies.
• Capable of delivering on multiple competing priorities with little supervision.
• Excellent verbal and written communication skills.
• Bachelor''''''''s Degree in computer science or equivalent experience.
The most successful candidates will also have experience in the following:
• Gitflow
• Atlassian products – BitBucket, JIRA, Confluence etc.
• Continuous Integration tools such as Bamboo, Jenkins, or TFS
Location: This position will be based in Bentonville, A
Skills
Similar jobs
Senior Cloud Computing Application Architect
Booz Allen Hamilton · Chantilly, United States
1 hour ago$86.8k - $198k/yrCloud Security Engineer – Risk Reduction (Remote)
Dahl Consulting · United States
1 hour ago€78/hrAzure Cloud Architect
kjohn@samrusystems.com · United States
1 hour agoOracle Cloud Finance Technical Architect
SVK Technology Solutions · United States
1 hour agoCloud Security Engineer – Risk Reduction
Dahl Consulting · Brooklyn Park, United States
2 hours ago€78/hrSenior Cloud Architect
HTC Global Services · United States
2 hours ago