Cloud Data Engineer

Sr. Cloud Data Engineer: - 10 Years of Hands on Experience

Key Skills:
Cloud Platforms: AWS ( Kubernetes), Google Cloud, Microsoft Azure.
Data Storage: Data lakes, data warehouses, cloud storage service (S3)
Data Pipelines: Developing and maintaining data pipelines for ETL processes leveraging GitHub Actions for promotions of code assets.
Programming Languages: Python, Java, Scala
Data Management Systems: SQL, NoSQL, Hadoop, Postgress
Data Security and Governance: Understanding of data security best practices and compliance regulations.
Problem-Solving and Analytical Skills: Ability to troubleshoot issues and analyze data to identify patterns and trends.

Key Responsibilities of a Cloud Data Engineer
Designing and implementing scalable and secure data storage solutions in the cloud, ensuring optimal performance and accessibility.
Developing and maintaining robust data pipelines for the ingestion, transformation, and distribution of large datasets.
Automating data processes and integrating third-party services
Utilizing cloud services and tools to automate data workflows and streamline the data engineering process.
Ensuring compliance with data governance and security policies, including data encryption and access controls.
Monitoring cloud data systems' performance (Cloud Watch), identifying bottlenecks, and implementing improvements to enhance efficiency.
Conducting data quality checks and implementing measures to ensure data accuracy and integrity.
Optimizing data retrieval and developing APIs for data consumption by various enterprise consumers.
Providing technical expertise and support for data-related issues, including troubleshooting and resolving data pipeline failures.
Collaborating with IT and security teams to plan and execute disaster recovery strategies for cloud-based data systems.
Documenting data engineering processes, creating data flow diagrams, and maintaining metadata for data lineage and cataloging.
Collaborating with architects, analysts, and other engineers to support data modeling, analysis, and reporting needs.
Staying current with emerging cloud technologies and data engineering practices to recommend and adopt innovations that improve data systems.


Benefits:

York Solutions Offers a generous benefits package for eligible full-time employees:

• BCBS Medical with 3 Plans to choose from (PPO and High deductible PPO plans with Health Savings Program)
  
• Delta Dental plan with 2 free cleanings and insurance discounts
  
• Eye Med Vision with annual check-ups and discounts on lens
  
• Life and Accidental Death Insurance paid by company
  
• John Hancock 401(k) Retirement Plan with discretionary company match
  
• Voluntary Insurance programs such as: Hospital Indemnity, Identity Protection, Legal Insurance, Long Term Care, and Pet Insurance.
  
• Flexible work environment with some remote working opportunities
  
• Strong fun and teamwork environment
  
• Learning, development, and career growth