Data Engineer

We're looking for a Data Engineer to help build and support data ingestion, integration, and transformation solutions for a fast-paced client project. This role offers the opportunity to work with modern big data tools, collaborate on impactful engineering work, and contribute to a hybrid environment with flexibility across East Coast Publicis Sapient office locations or on site in Knoxville, TN.
Responsibilities

• Design, build, and support data pipelines that handle batch and real-time ingestion from multiple sources
• Develop solutions for data integration, transformation, storage, search, and aggregation
• Work across big data frameworks and platforms to improve scalability, reliability, and performance
• Collaborate with technical teams to translate business needs into practical data engineering solutions
• Participate in design discussions and help ensure the overall health of the solution architecture
• Support data engineering efforts involving cloud-based infrastructure and analytics use cases
• Contribute to troubleshooting, optimization, and enhancement of existing data workflows

Skills

• 4+ years of relevant experience working with big data technologies
• Hands-on experience with Hadoop ecosystem tools such as HDFS, Kafka, Spark, Spark Streaming, Hive, Airflow, NiFi, Flink, or similar technologies
• Strong programming skills in Java, Scala, or Python, with Java preferred
• Experience working with NoSQL and MPP data platforms such as HBase, MongoDB, Cassandra, Redshift, Azure SQL DW, or BigQuery
• Working knowledge of AWS data platform services
• Ability to design and implement data engineering solutions independently
• Strong problem-solving, communication, and collaboration skills
• Bachelor's degree or equivalent combination of education, training, and experience

Preferred Skills

• Experience with ETL tools such as Informatica or Talend
• Familiarity with databases such as Oracle, MySQL, SQL Server, or Postgres
• Knowledge of data governance practices including security, lineage, and cataloging
• Exposure to tools such as Collibra or Alation
• Understanding of messaging frameworks such as ActiveMQ, RabbitMQ, or Solace
• Experience with search and indexing technologies
• Background in microservices architecture
• Experience with performance tuning and pipeline optimization
• Cloud data certifications or other relevant big data credentials

Horizontal is committed to fostering an inclusive and welcoming environment where different perspectives are valued and every team member can contribute meaningfully. We believe diversity, equity, and inclusion strengthen our teams and help drive better outcomes for everyone.

By applying for this position, you acknowledge and agree that Horizontal Talent may contact you regarding your application using automated technology, including phone calls, SMS/text messages, or email, which may be delivered by our virtual AI recruiter, Alex.