Back to Jobs
Technology

Data Engineer

Sahi SofttechUnited States🇺🇸United States

Why this role stands out

This hybrid role offers incredible growth potential as you'll design and develop sophisticated data pipelines and data lakes using cutting-edge AWS services and Snowflake. You'll thrive here if you have extensive experience in enterprise data architecture and a passion for leveraging big data technologies to drive insights. Apply now to join a reputable company and advance your career in data engineering.

Quick overview

Work modeHybrid
LocationUnited States
MicroservicesOracleSQLGitAWSETLSnowflakePythondbtMachine LearningSQL ServerAgileStreamlit

Job description

Data Engineer

The Data Engineer is a hands-on technical role focused on full stack software development within the Enterprise Data organization. The role will play curtail part in shaping future big data and analytics initiatives.

PRINCIPAL RESPONSIBILITIES

  • Designs and develops code and data pipelines to ingest from relational databases (Oracle, SQL Server, DB2, Aurora), file shares, and web services.
  • Build Data Lake on AWS S3 with optimal performance considerations by partitioning and compressing data.
  • Data Engineering and Analytics using AWS Glue, Informatica, EMR, Spark, Athena, Python.
  • Data modeling and building Data Warehouse using Snowflake, DBT.
  • Designs and develops code and data pipelines to ingest relational databases, file shares, and web services.
  • Participates in requirements definition, system architecture design, and data architecture design.
  • Participates in all aspects of the software life cycle using Agile development methodologies.
  • Experience designing and implementing Medallion Architecture (Bronze, Silver, Gold layers) for enterprise data platforms.
  • Hands-on experience with SQLDBM for data modeling, schema design, and data warehouse architecture documentation.
  • Experience developing conceptual, logical, and physical data models using SQLDBM and collaborating with business and technical stakeholders on model reviews.


MINIMUM QUALIFICATIONS:

  • Bachelor’s degree in computer science, Computer Information Systems, Engineering, Statistics or closely related field (willing to accept foreign education equivalent) (required).
  • Experience in AWS services for data and analytics (required).
  • 5 years of experience in Data Ingestion, Data Extraction, and Data Integration (required).


PREFERRED QUALIFICATIONS:

  • 7+ years of experience in Enterprise Information Solution Architecture, Design, and development required.
  • 7+ years of experience with integration architectures such as SOA, Microservices, ETL or other integration technologies.
  • 7+ years of experience with working content or knowledge management systems, search engines, relational databases, NoSQL databases, ETL tools, geospatial systems, or semantic technology.
  • 5+ years of hands-on experience with AWS services ( S3, Kinesis, Lambda, Athena, Glue, EMR) required.
  • 5+ years’
  • Experience with JSON or XML data modeling required.
  • Experience with Git/GitHub, branching, and other modern source code management methodologies required.
  • Domain knowledge of NoSQL or relational database required.
  • Understanding of database architecture and performance implications required.
  • Experience integrating Business Intelligence applications like PowerBI.
  • Experience with Machine Learning and Artificial Intelligence.
  • Ability to multi-task effectively.
  • Ability to work collaboratively as part of an Agile Team.
  • Extensive knowledge and experience with Python and Snowflake Streamlit.
  • Excellent written and verbal communication skills, sense of ownership, urgency and drive.

Will your resume get past this employer's screening? Check your resume against this job, free

Similar jobs