Data Engineer

Role Name : Data Engineer Location: Plano, TX
Rate: $70 - 80/hr on W2
Employment Type: W2 Only
Candidate Requirement: Local candidates only
Client: JPMC
Interview Process: Round 1 Zoom | Round 2 In-Person at JPMC Location

Job Description:

We are seeking an experienced Data Engineer with strong hands-on expertise in PySpark, Java, Spark, and ETL/streaming pipelines. The ideal candidate will have experience developing scalable data processing solutions, building cloud-based applications using AWS services, and applying software engineering best practices throughout the development lifecycle. Familiarity with infrastructure automation and LLM-based solutions is a plus.

Key Responsibilities:

• Design, develop, test, deploy, maintain, and improve software applications and data processing solutions using Java or Python.

• Build and maintain ETL and streaming pipelines using PySpark, Apache Spark, and related technologies.

• Develop scalable data engineering solutions and integrate AWS services such as SQS, Lambda, S3, and RDS.

• Apply appropriate software design techniques and engineering best practices to develop reliable, secure, and maintainable applications.

• Participate in the complete software development lifecycle, including business analysis, development, testing, deployment, maintenance, and continuous improvement.

• Follow Agile methodologies and collaborate with cross-functional teams to deliver quality solutions.

• Apply Continuous Integration, Continuous Delivery, Test-Driven Development, cloud development, application resiliency, and security practices.

• Contribute to infrastructure automation using Terraform and support Unix-based environments and shell scripting as needed.

• Explore and contribute to practical LLM use cases using Azure OpenAI or related technologies, where applicable.

Required Qualifications:

• 4 5+ years of applied software engineering experience, supported by formal training or relevant certification in software engineering concepts.

• Extensive hands-on experience with PySpark, Java, Spark, and ETL/streaming pipelines.

• Advanced proficiency in Python or Java.

• Experience with AWS services, including SQS, Lambda, S3, and RDS.

• Strong understanding of software development methodologies, design techniques, and the software development lifecycle.

• Experience with Agile methodologies and at least one common Agile framework.

• Understanding of Continuous Integration, Continuous Delivery, Test-Driven Development, cloud development, application resiliency, and security.

• Bachelor's degree in Computer Science, Computer Engineering, Mathematics, or a related technical field.

• Must be local to Plano, TX, and available for an in-person second-round interview at the JPMC location.

Preferred Qualifications:

• Experience with shell scripting and Unix/Linux systems.

• Proficiency in Terraform for infrastructure management.

• Familiarity with modern Large Language Model (LLM) techniques.

• Practical LLM use case development experience using Azure OpenAI.

Mandatory Required Skills:

Data Engineering, PySpark, Apache Spark, Java, Python, ETL Pipelines, Streaming Pipelines, AWS, Amazon SQS, AWS Lambda, Amazon S3, Amazon RDS, Software Engineering, Application Development, Agile, CI/CD, Continuous Integration, Continuous Delivery, Test-Driven Development, Cloud Development, Application Resiliency, Application Security

Preferred Skills: Shell Scripting, Unix, Linux, Terraform, Large Language Models, LLM, Azure OpenAI