Data Engineer with AI/ML Framework - Denver, CO (In-Person Interview)

Those who can do In-person interview with Client.

Primary Skill Expectations:- Strong in SQL, Spark , Good Communication.

Job Overview:
We are seeking a skilled professional with strong expertise in Python, Spark, and leading AI/ML frameworks to design and build scalable, intelligent data solutions. The ideal candidate will have hands-on experience with big data platforms and distributed data processing.

• Design, develop, and maintain scalable ETL/ELT data pipelines using Apache Spark and SQL
• Build and optimize batch and near real-time data processing workflows across large-scale datasets
• Develop data ingestion, transformation, and data quality frameworks for enterprise data platforms
• Work with Delta Lake, data lakes, and cloud-based big data environments to ensure reliable data processing
• Perform data modeling, query tuning, and performance optimization for large datasets
• Integrate data from multiple source systems, databases, and external platforms
• Implement data validation, monitoring, and troubleshooting processes to ensure data integrity
• Collaborate with business analysts, architects, and cross-functional teams to deliver data-driven solutions
• Support data governance, security, and compliance requirements across the data ecosystem

Required Skills

• Strong proficiency in Apache Spark (PySpark) and SQL
• Extnsive experience developing and optimizing ETL/ELT pipelines
• Strong understanding of distributed data processing concepts and Spark architecture
• Experience working with relational and non-relational databases
• Proficiency in data modeling, performance tuning, and query optimization
• Experience with workflow orchestration and scheduling tools (e.g., Airflow, Control-M, Azure Data Factory, or similar)
• Familiarity with cloud data platforms such as Azure, AWS, or Google Cloud
• Strong problem-solving, analytical, and troubleshooting skills