Big Data Engineer - Google Cloud Platform Charlotte - NC - North Carolina

Must-Have Skills - W2 role

Education: Bachelor s or Master s degree in Computer Science, Computer Engineering, another technical discipline, or equivalent work experience.

Experience: 5+ years of hands-on software development experience with Big Data and analytics solutions.

Google Cloud Platform and Big Data: Hands-on experience with Google Cloud Platform technologies, including BigQuery, Dataproc, PubSub, and Airflow, plus Hadoop, Hive, and Spark.

Programming and scripting: Strong Python and shell-scripting skills.

Data engineering: Strong experience designing, developing, and optimizing scalable data pipelines for large-scale data processing, transformation, and analysis.

SQL and data modelling: Proficiency in SQL and relational database systems, including designing and optimizing data models for performance and scalability.

Event processing: Experience building event-driven processing pipelines using Kafka or Google Cloud PubSub.

Distributed systems: Knowledge of distributed, multi-tiered systems and algorithms.

Software engineering: Strong object-oriented programming skills and knowledge of design patterns.

CICD and source control: Experience with CICD pipelines, automated testing frameworks, and source-code management tools such as Jenkins and Git.

Problem solving: Ability to analyze complex data-engineering problems, propose effective solutions, and implement them successfully.

Enterprise frameworks: Ability and willingness to learn, adopt, and build solutions using established enterprise Big Data frameworks.

Collaboration: Effective communication with product and cross-functional teams.

Delivery methodology: Understanding of SDLC methodologies and familiarity with Agile and Scrum ceremonies.

Continuous improvement: Proactive approach to identifying improvement opportunities and willingness to learn and apply new technologies.

Nice-to-Have Skills

Workflow and messaging tools: Additional design and development experience with Airflow, PubSub, and Kafka.

DevOps tooling: Experience with Git, GitHub, Jenkins, XLR, and configuration-management practices.

Regulatory technology: Experience building innovative engineering solutions for financial-crimes compliance.

Engineering excellence: Experience improving resilience, predictability, delivery efficiency, and automation within engineering teams.

Product partnership: Experience partnering with product teams to envision and deliver technology-led transformation.

Certification: Google Cloud Professional Data Engineer certification.