Start searching
Back to Jobs
Recently postedTechnology

Senior Data Engineer (Informatica & PySpark)

Sabio infotechPittsburgh, PA🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeOn Site
LocationPittsburgh, PA, United States
Apache SparkAWSETLHadoopHiveKafkaPythonMachine LearningJiraAgileData Analysis

Job description

Senior Data Engineer (Informatica & PySpark)
Priority Type: Full-Time
Location: Cleveland, OH or Pittsburgh, PA (3 days onsite)
Job Duties:-
· Experience: 8–10 years in Data Engineering and Data Analysis.
· Informatica Expertise: Strong hands-on experience in Informatica PowerCenter/IDQ for ETL design, development, and optimization.
· PySpark Development: Advanced skills in PySpark for large-scale data processing, transformation, and analytics.
· Hadoop Ecosystem: Solid working knowledge of Hadoop technologies (HDFS, Hive, Sqoop, MapReduce).
· Programming Skills: Proficiency in Python and Kafka for streaming and batch data pipelines.
· Database & Modeling: Strong understanding of database concepts, data design, data modeling, and ETL workflows.
· ETL Lifecycle: Experience in analyzing, designing, and coding ETL programs including data extraction, ingestion, quality checks, normalization, and loading.
· Agile Delivery: Hands-on experience with Agile methodology and Jira for project delivery.
· Client Interaction: Proven ability in client-facing roles with strong communication and leadership skills to coordinate across SDLC.
· Preferred Skills:
o Exposure to AWS data components and analytics.
o Familiarity with machine learning models and AI concepts.
o Experience with data modeling tools such as Erwin.
Qualifications
· Master’s or bachelor's degree in computer science or related field.
· Strong problem-solving skills and ability to work in cross-functional teams.

Similar jobs

Apply