Why This Role Stands Out
Leverage your expertise in Python, Pyspark, and Google Cloud Platform to design and optimize large-scale data pipelines in a hybrid environment that fosters continuous learning and innovation. If you have 3+ years of experience in Big Data and ETL, and enjoy tackling complex data engineering challenges within a reputable tech company, this is an excellent opportunity to grow your career.
Quick Overview
Job Description
We need 3+ years exp candidates
JD -
Python, Pyspark, Google Cloud Platform, ETL - Big Data/Data Warehousing, Data Analytics, SQL, Git (GitHub, Git Lab, Bit Bucket, SVN)
Key Responsibilities: Details BS or MS degree in computer science, computer engineering, or other technical discipline, or equivalent work experience. 5+ years of hands-on software development experience with Big Data & Analytics solutions Google Cloud Platform Cloud - Big Query, Airflow, DataProc, PubSub, Hadoop Hive, Spark, Python, shell scripting, Strong experience in designing, developing, and optimizing data pipelines for large-scale data processing, transformation, and analysis using Big Data and Google Cloud Platform technologies. Proficiency in SQL and database systems, with experience in designing and optimizing data models for performance and scalability. Experience of building event processing pipelines with Kafka or Google Cloud Platform PubSub. Design and development experience with Airflow, PubSub Kafka, Git, Jenkins is desirable. Knowledge of distributed (multi-tiered) systems, algorithms & relational databases. Strong Object-Oriented Programming skills and design patterns. Experience with CICD pipelines, Automated test frameworks, and source code management tools (XLR, Jenkins, Git). Good knowledge and experience with configuration management tools like GitHub Ability to analyze complex data engineering problems, propose effective solutions, and implement them effectively. Ability and willingness to learn, adopt and build solutions using the Enterprise frameworks established for Big Data Looks proactively beyond the obvious for continuous improvement opportunities. Communicates effectively with product and cross functional team. Willingness to learn new technologies and leverage them to their optimal potential. Understanding of various SDLC methodologies, familiarity with Agile & scrum ceremonies. Certifications in cloud platform (Google Cloud Platform Professional Data Engineer) is a plus.
Provide engineering expertise to the team for developing features for Banking including Financial Crimes, Anti-money Laundering platforms Improve engineering practices, including driving resilience, predictability, and end efficiency through automation Partner with product teams to envision and deliver solutions which transform Financial Crimes Compliance using technology
Required Skills: Python, Pyspark, Google Cloud Platform, ETL - Big Data/Data Warehousing, Data Analytics, SQL, Git (GitHub, Git Lab, Bit Bucket, SVN)
Similar jobs
- SD
Infrastructure Engineer
NewAuto ApplyStrata Decision Technology
Chicago🇺🇸Hybrid1 hour agoDockerAnsibleCapacity Planning+6Technology - BT
Cloud Network Engineer
NewBansar Technologies Inc.
Austin, TX🇺🇸On-site17 hours agoOracleAWSAzure+1Technology - EV
Senior Network Engineer
NewEvolver
Washington, DC🇺🇸Hybrid17 hours agoAWSDNSZero TrustTechnology - TA
Cloud Data Engineer
NewThe Avian Consulting LLC
Ottawa, ON🇺🇸On-site17 hours agoSQLSQL ServerETL+5Technology - GI
Network Engineer
NewGalaxy i Technologies, Inc.
Miami, FL🇺🇸Hybrid17 hours agoAWSAnsibleAzure+3Technology - VA
Senior Network Engineer
NewVaco LLC
Nashville, TN🇺🇸$48/hrOn-site17 hours agoGDPRTechnology - RI
Senior Cloud Engineer
NewRaas Infotek LLC
United States🇺🇸Hybrid17 hours agoDockerAWSEdge Computing+23Technology - SY
Azure Cloud Engineer / Administrator / Networking /Systems Admin
NewSymphony Corporation
United States🇺🇸Hybrid17 hours agoMFAAzureBash+9Technology - ST
Google Cloud Platform Architect- Irving, TX 100% Onsite
NewSaim Technologies
Irving, TX🇺🇸On-site17 hours agoBigQueryGoogle Cloud - CS
Infrastructure and Cloud Systems Engineer
NewCrossword Staffing Solutions LLC
Irving, TX🇺🇸Hybrid17 hours agoAWSEncryptionActive Directory+4Technology - AG
AWS Engineer
NewASCII Group LLC
Plano, TX🇺🇸$65/hrOn-site17 hours agoEngineering - ER
Azure Cloud Engineer Richmond, VA ( Must be current resident of MD/WV/KY/TN/NC/DC as in-person interview is required) - Long Term C2C role
NewERPA
Richmond, VA🇺🇸Hybrid17 hours agoDockerSSOAzure+5Technology