Back to Jobs
Recently postedOther

Data Engineering

Thinking Minds Inc.Atlanta, GA🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeHybrid
LocationAtlanta, GA, United States
MongoDBMySQLSQLScalaApache SparkETLEncryptionScikit-learnBigQueryCassandraDatabricksGoogle CloudHadoopJupyterKafkaPandasPythonTensorFlowAzureMachine LearningAgileCI/CDMatplotlib

Job description

Location: United States Experience: Extensive relevant experience Job Type: Permanent
### Top Skills & Technologies ETL | SQL | NoSQL | Spark | Databricks | Google Cloud Platform | Python | Kafka
### Job Summary Thinking Minds' client is seeking a principal-level data engineering leader to own enterprise-scale initiatives and advance the design, delivery, and reliability of complex data platforms. This role connects business stakeholders, software engineers, and data scientists, translating challenging requirements into reusable engineering solutions.

The successful candidate will establish technical standards, guide production deployments, review code, and mentor engineers while delivering accessible, trustworthy data for analytics and data-driven products.
### Ideal Candidate Should Have
An engineering mindset that balances computational efficiency, sound architecture, and pragmatic delivery. A demonstrated record of deploying complex production systems and distributed solutions that deliver measurable business value.

Strong communication skills, including the ability to advise senior stakeholders and support multidisciplinary, geographically distributed teams. Confidence navigating ambiguous problems, resolving difficult technical obstacles, and promoting reusable patterns and code.
###

Key Responsibilities
Own the design, implementation, testing, and maintenance of large-scale data pipelines, including automated ingestion, transformation, ETL, batch processing, and real-time processing. Create data models and schemas for analytics and reporting; collaborate with application teams to integrate downstream systems. Strengthen Data Quality, integrity, accessibility, and lineage through validation, investigation, documentation, and performance troubleshooting. Advance Data Governance and security through access controls, encryption, and adherence to established policies.

Establish engineering standards, conduct code reviews, guide large-scale deployments, and improve delivery through CI/CD, agile, and devops practices. Build reusable parsers, validators, transformers, and correlators; mentor engineers and advise technical leaders.
### Required Qualifications
Bachelor's degree in Information Systems, Computer Science, Mathematics, Engineering, or a related quantitative discipline, or equivalent formal training or work experience.

Extensive knowledge of data engineering, machine learning frameworks, distributed systems, and complex batch or online transaction-based systems. Expertise with relevant processing technologies such as Hadoop, Spark, Scala, PySpark, HDFS, and Kafka. Experience with SQL and NoSQL storage tools such as MySQL, Postgres, Cassandra, MongoDB, and ElasticSearch. Proficiency with Python data tools such as Pandas, Scikit-Learn, Matplotlib, TensorFlow, and Jupyter.

Working knowledge of Databricks (also styled DataBricks), BigQuery, and Google Cloud Platform, alongside cloud architecture, version control, and collaborative software delivery.
###

Preferred Qualifications
Detailed knowledge of Microsoft Azure tooling for large-scale data engineering and deployments.
A directly related PhD or related advanced degree.
Transportation industry knowledge and experience applying statistics, predictive analytics, or simulation to business problems.
Thinking Minds' client offers enterprise-level technical ownership, collaborative problem-solving, and opportunities to shape engineering practices and mentor emerging talent.
#Dice

Similar jobs