Quick overview
Job description
The combination of rapid growth and an international and innovative environment! This is creating many opportunities for people like YOU: people with an entrepreneurial spirit who want to make a difference in this world.
At Cognizant, together with your colleagues from all around the world, you will collaborate on creating solutions for the world's leading companies and help them become more flexible, more innovative, and successful. Moreover, this is your chance to be part of the success story.
Position SummaryExperienced Data Engineer with over 5+ years of expertise in designing, developing, and optimising large-scale data engineering solutions within Banking and Financial Services domains. Proficient in Apache Spark, PySpark, SparkSQL, HDFS, Hive, ADLS2, Azure Synapse Analytics, Python, and HBase, with strong experience in building scalable data ingestion, transformation, and processing frameworks. Microsoft Certified DP-203: Azure Data Engineer Associate, demonstrating expertise in designing and implementing data integration, storage, processing, monitoring, and security solutions in Azure environments. Extensive experience working across complete Software Development Life Cycle (SDLC) phases using Agile and Waterfall methodologies. Skilled in performance tuning, troubleshooting, production support, root cause analysis, and delivering high-quality solutions in complex enterprise environments. Proven track record of leading technical initiatives, mentoring team members, driving successful production implementations, and collaborating with cross-functional stakeholders to deliver business-critical projects on time and with high quality. Recognized for strong analytical thinking, problem-solving capabilities, customer focus, and commitment to continuous learning and innovation.
Mandatory Skills- Skills/Tools: Apache Spark, PySpark, Spark SQL, HDFS, ADLS2, Azure Synapse Analytics, ServiceNow, Enterprise Control-M, BT-Control-M.
- Cloud & Data Platforms: Azure Data Lake Storage (ADLS2), Azure Synapse Analytics, Databricks.
- Programming Languages: Python, HiveQL, Spark SQL.
- Databases: Hive, MySQL.
- Build & Deployment Tools: Bitbucket, Jenkins, CI/CD Pipeline Implementation.
- Job Scheduling Tools: BMC Control-M.
- Monitoring & Troubleshooting: Spark Logs Analysis, Root Cause Analysis, Production Support.
- ITSM Tools: ServiceNow.
- Security & Compliance: Data Governance, Security Best Practices, Change Management.
- Domain Expertise: Banking and Financial Services.
- Collaborate with cross-functional teams to analyze, design, and implement scalable data engineering solutions.
- Design, develop, and optimize enterprise-grade data processing pipelines using PySpark and Spark SQL.
- Build and maintain scalable data ingestion, transformation, and aggregation frameworks leveraging Spark DataFrames, Hive, HDFS, and ADLS2.
- Perform Spark performance tuning and optimization to improve resource utilization and processing efficiency.
- Develop complex Spark SQL and HiveQL queries to support business-critical data processing requirements.
- Design and implement robust data transformation logic while adhering to coding standards and best practices.
- Investigate, troubleshoot, and resolve production issues through detailed log analysis and root cause identification.
- Drive operational excellence by implementing proactive monitoring and reliability improvements.
- Configure, schedule, and manage enterprise data workflows using BMC Control-M.
- Manage source code versioning and collaboration through Git and Bitbucket.
- Create, review, and implement Change Requests (CRQs) in accordance with organizational governance processes.
- Maintain comprehensive technical documentation, deployment procedures, and operational support artifacts.
- Support production releases and platform upgrade activities while ensuring service continuity.
- DP-203 Data Engineering
- Data Engineering with Databricks
- IBM Skill Badge - Artificial Intelligence
- AI Security & Governance by Security
$80,000-90,000
Date of Posting17-Nov-26
Successful candidates will be required to undergo a background check.
Cognizant is committed to providing Equal Employment Opportunities.
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- CT
Data Engineer - FivetranRecently posted
Cognizant Technology Solutions Corporation · Sydney · Hybrid · Posted 18 Nov 2026 🇦🇺
SQLGitAWS+6TechnologySalary not listed - CT
Fivetran Data Engineer: ELT Pipelines & Data QualityRecently posted
Cognizant Technology Solutions Corporation · Sydney · Hybrid · Posted 18 Nov 2026 🇦🇺
TechnologySalary not listed - SF

Lead Data Engineer, Azure Databricks Platform (Hybrid)Recently posted
Shift Financial Pty · Sydney · Hybrid · Posted 18 Nov 2026 🇦🇺
DatabricksAzureTechnologySalary not listed - MC

Data EngineerRecently posted
Mane Consulting · Melbourne · Hybrid · Posted 18 Nov 2026 🇦🇺
SQLT-SQLApache Spark+7TechnologySalary not listed - CT
Senior Azure Data Engineer - Spark, Synapse & Big DataRecently posted
Cognizant Technology Solutions Corporation · Sydney · Hybrid · Posted 18 Nov 2026 🇦🇺
SQLApache SparkPython+1TechnologySalary not listed - SF

Senior Data EngineerRecently posted
Shift Financial Pty · Sydney · Hybrid · Posted 18 Nov 2026 🇦🇺
SQLGitDatabricks+6TechnologySalary not listed - MC

Azure Data Engineer: Scale Data Pipelines & InsightsRecently posted
Mane Consulting · Melbourne · Hybrid · Posted 18 Nov 2026 🇦🇺
DatabricksAzurePower BI+1TechnologySalary not listed - ES
GCP Data Engineer - Contract or PermRecently posted
Eighty20 Solutions · Sydney · Hybrid · Posted 29 Oct 2026 🇦🇺
GCPBigQueryGoogle Cloud+1TechnologySalary not listed - XE
Senior Data Engineer - Performance Insights & AI LayerRecently posted
Xero Limited · Sydney · Hybrid · Posted 17 Nov 2026 🇦🇺
SnowflakedbtTechnologySalary not listed - TE
Storage EngineerRecently posted
Teamified · Melbourne · Hybrid · Posted 17 Nov 2026 🇦🇺
Microsoft OfficeDNSUnity+1TechnologySalary not listed - AM

Systems Specialist Logistics and Systems Engineering DatabaseRecently posted
Amentum · Sydney · On-site · Posted 17 Nov 2026 🇦🇺
Logistics ManagementSalary not listed - UN

Technical Lead - Data Platform AdministratorRecently posted Auto Apply
UniSuper · Melbourne · Hybrid · Posted 17 Nov 2026 🇦🇺
Stakeholder ManagementSQLT-SQL+5A$1.5k/mo