
Senior Data Engineer / Software Engineer (SQL, Databricks, Java, Spark)
Quick overview
Job description
Job Description
- Participate in modernization and upgrade of the Credit Risk technology stack in accordance with the industry best practices
- Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
- Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems
- Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
- Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems
- Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture
- Contributes to software engineering communities of practice and events that explore new and emerging technologies
- Leverages enterprise-authorized AI coding assist tools within the work environment to improve code quality, delivery speed, and productivity across complex deliverables (e.g., code generation/refactoring, unit test creation, documentation), while validating outputs through peer review, automated testing, and secure coding standards; contributes learnings and reusable patterns to improve broader team effectiveness.
- Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 8+ years of applied experience
- Hands-on practical experience in system design, application development, testing, and operational stability
- Proficient in coding (Java or Python)
- Strong knowledge of relational databases/ Transact SQL, caching technologies (Oracle/Postgres/SQL Server/elastic etc), Kafka, Apache Spark
- Working knowledge of Databricks, AWS
- Strong Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages
- Overall knowledge of the Software Development Life Cycle
- Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting, or documentation) with demonstrated ability to critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and security.
- Understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within team practices.
Preferred qualifications, capabilities, and skills
- Exposure to cloud technologies (e.g. AWS, Databricks, Snowflake)
Additional details
- - >10-12 years of experience with strong Expertise Oracle PL/SQL. You can read and reason about complex legacy packages, views and procedural logic.
- - Strong SQL and Databricks SQL. Good knowledge of Delta Lake (MERGE, time travel, partitioning, table versus view behaviour) and Unity Catalog.
- - Hands-on dbt: models, snapshots, macros, Jinja, hooks, unit tests, and multi-environment configuration.
- - Experience in Java, Scala/Spark, Spring Boot, Kafka Messaging, Kubernetes, Docker, S3, DeltaLake, Dremio
- - Proven data modelling: dimensional and SCD2 history, grain design, keys, and point-in-time / as-of queries.
- - Performance tuning on Spark or Databricks: query plans, join strategy, caching and materialization, partition pruning.
- - Experience of legacy-to-cloud data migrations with formal parity and reconciliation.
- - Strong written communication: you can turn code into clear business-rule documentation.Best RegardsSravanTalent Acquisition Specialist📞+1 | ✉️🌐 | Intuitive Insights LLC
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- GT
Senior Data Engineer with AIRecently posted
Goldenpick Technologies LLC · Dallas, TX · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerNeo4jSQL+23TechnologySalary not listed - SS

Data Engineer with Autosys & StonebranchRecently posted
Softcom Systems · Weehawken Township, NJ · Hybrid · Posted 19 Nov 2026 🇺🇸
ShellETLNumPy+5TechnologySalary not listed - LO
Data Engineer – Cloud Security (AWS)Recently posted
Logicplanet, Inc. · Milpitas, CA · On-site · Posted 19 Nov 2026 🇺🇸
AWSEncryptionCDK+4TechnologySalary not listed - AM

Data Engineer Lead - W2Recently posted
Ampcus Inc · Columbus, OH · Hybrid · Posted 19 Nov 2026 🇺🇸
Apache SparkETLSnowflake+9TechnologySalary not listed - RD

Data Engineer (EDA)Recently posted
Randstad Digital · Irving, TX · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLETLSnowflake+1Technology$69 - $70/hr - FL
Senior PostgreSQL DBARecently posted
Flexton Inc · Los Angeles, CA · Remote · Posted 19 Nov 2026 🇺🇸
MySQLOracleSQL+25TechnologySalary not listed - PS

Senior Snowflake Data Engineer (Informatica) Remote (Local)Recently posted
Paramount Software Solutions, Inc · Denver, CO · Remote · Posted 19 Nov 2026 🇺🇸
SQLGitETL+6TechnologySalary not listed - GA

Staff Data EngineerRecently posted Auto Apply
Gamechanger · GameChanger Remote - US · Remote · Posted 18 Nov 2026 🇺🇸
SQLAWSMLOps+8Technology$170k - $185k/yr - SP

Snowflake & Informatica Data EngineerRecently posted
Stellar Professionals LLC · United States · On-site · Posted 19 Nov 2026 🇺🇸
SQLGitETL+5TechnologySalary not listed - TH

Data EngineerRecently posted
The Hollister Group · Pittsburgh, PA · On-site · Posted 19 Nov 2026 🇺🇸
SQLAWSETL+7Technology$75k - $85k/yr - VN

Data EngineerRecently posted
Virtual Networx · Boston, MA · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLETLDatabricks+4TechnologySalary not listed - EG

Data EngineerRecently posted
Eliassen Group · Pittsburgh, PA · On-site · Posted 19 Nov 2026 🇺🇸
JavaTechnologySalary not listed