Sr. DevOps Engineer

We are seeking a hybrid DevOps + Data Engineering profile, with a stronger emphasis on DevOps capabilities. The role owner will be required to modify & manage ETL pipelines as part of platform operations. The role owner should have hands on DevOps experience along with good understanding of data pipelines.

Qualification:

·       Bachelor’s degree in computer science, engineering, or related field (master''''s degree is a plus)

·       Demonstrated continued learning through one or more technical certifications or related methods

·       At least 9+ years of relevant experience; two years may be substituted for a master’s degree

Work and Technical Experience: Must-Have Skill Set:

·       Terraform

·       CI/CD Pipelines

·       Platform upgrades and maintenance

·       QA exposure – integration & platform testing

·       Deep understanding of cloud data services (AWS) and migration strategies.

·       Strong proficiency in ETL/ELT pipelines and framework development using Python.

·       Development may not be needed but understanding is required

·       Modifying & monitoring data pipelines for batch and real-time processing.

·       Exceptional communication skills for engaging executives and non-technical stakeholders.

·       Knowledge of containerization (Docker, Kubernetes) and orchestration for data workloads.

Key Result Areas and Activities:
1. DevOps requirements

·       Modify and manage data pipelines in DevOps setup.

·       Good understating of CI/CD pipelines.

2. Development responsibilities:
I. Software Asset Maintenance & Upgrades:

·       Upgrade and maintain third-party components such as ingress controllers, service meshes, monitoring agents, infrastructure libraries, and cloud-native tools.

·       Apply the latest versions and security patches to ensure compliance, stability, and performance.

II. Infrastructure as Code (IaC) Enhancements:

·       Update and enhance IaC scripts to support version upgrades across development, QA, and production environments.

·       Validate changes through sandbox testing before deployment to production.

III. Compatibility & Dependency Management:

·       Ensure upgraded components remain compatible with dependent services and applications.

·       Identify and mitigate potential breaking changes or dependency conflicts.

IV. Application Code Adjustments:

·       Implement necessary code changes in supported languages (e.g., Python) to accommodate new versions or configuration requirements.

·       Address minor and moderate changes required for compatibility with upgraded components.

·       Update existing unit tests in response to the application code changes.

V. Security & Compliance:

·       Apply immediate fixes for vulnerabilities.

·       Maintain adherence to organizational security and governance guidelines.

VI. Testing & Validation:

·       Create and execute test strategies for validating the upgrades.

·       Execute existing unit tests and manual test cases post-upgrade.

·       Conduct functional testing of impacted applications to ensure end-to-end stability.

·       Validate application behaviour after code changes and infrastructure updates.

VII. Reporting & Governance:

·       Provide weekly status reports detailing software versions, security posture, upgrade activities, and testing outcomes. Participate in regular reviews and acceptance processes.