Big data engineer

Big Data Engineer(Azure)
Long term
Onsite - Dallas,TX and Chicago,IL
Client : BCBS




Key Skills & Experience:

Worked with large and messy data from different sources to find useful insights.
Built data processes to clean, organize, and manage data, including handling metadata and tracking dependencies.
Good at working with different teams and managing projects effectively.
Strong SQL skills with experience using relational databases and writing complex queries.
Familiar with tools like Hadoop, Pig, and Datameer for big data processing.
Built and improved data pipelines and systems to handle big data efficiently.
Investigated data issues to find the root cause and suggest improvements.

Hands-on experience with tools and technologies like:
Hive, Hadoop, Spark, Kafka, Pig.
Azure Synapse, Datameer,Databricks.
SQL and NoSQL databases.