Back to Jobs
Recently postedTechnology

Senior Data Engineer / Software Engineer (SQL, Databricks, Java, Spark)

Intuitive Insights LLCHouston, TX🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeOn Site
LocationHouston, TX, United States
DockerOraclePL/SQLSQLScalaSpringSpring BootApache SparkAWSSnowflakeApacheDatabricksJavaKafkaPythonUnitydbtKubernetesSQL ServerDelta LakeSystem Design

Job description

Hi, I'm Hiring for
Job Title:
Senior Data Engineer / Software Engineer (SQL, Databricks, Java, Spark)

Duration: 6 Months - Contract to hire

Location: Houston, TX -Onsite

Job Description

  • Participate in modernization and upgrade of the Credit Risk technology stack in accordance with the industry best practices
  • Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
  • Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems
  • Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
  • Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems
  • Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture
  • Contributes to software engineering communities of practice and events that explore new and emerging technologies
  • Leverages enterprise-authorized AI coding assist tools within the work environment to improve code quality, delivery speed, and productivity across complex deliverables (e.g., code generation/refactoring, unit test creation, documentation), while validating outputs through peer review, automated testing, and secure coding standards; contributes learnings and reusable patterns to improve broader team effectiveness.
  • Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.

Required qualifications, capabilities, and skills

  • Formal training or certification on software engineering concepts and 8+ years of applied experience
  • Hands-on practical experience in system design, application development, testing, and operational stability
  • Proficient in coding (Java or Python)
  • Strong knowledge of relational databases/ Transact SQL, caching technologies (Oracle/Postgres/SQL Server/elastic etc), Kafka, Apache Spark
  • Working knowledge of Databricks, AWS
  • Strong Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages
  • Overall knowledge of the Software Development Life Cycle
  • Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting, or documentation) with demonstrated ability to critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and security.
  • Understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within team practices.

Preferred qualifications, capabilities, and skills

  • Exposure to cloud technologies (e.g. AWS, Databricks, Snowflake)

Additional details

  • - >10-12 years of experience with strong Expertise Oracle PL/SQL. You can read and reason about complex legacy packages, views and procedural logic.
  • - Strong SQL and Databricks SQL. Good knowledge of Delta Lake (MERGE, time travel, partitioning, table versus view behaviour) and Unity Catalog.
  • - Hands-on dbt: models, snapshots, macros, Jinja, hooks, unit tests, and multi-environment configuration.
  • - Experience in Java, Scala/Spark, Spring Boot, Kafka Messaging, Kubernetes, Docker, S3, DeltaLake, Dremio
  • - Proven data modelling: dimensional and SCD2 history, grain design, keys, and point-in-time / as-of queries.
  • - Performance tuning on Spark or Databricks: query plans, join strategy, caching and materialization, partition pruning.
  • - Experience of legacy-to-cloud data migrations with formal parity and reconciliation.
  • - Strong written communication: you can turn code into clear business-rule documentation.
    Best Regards
    Sravan
    Talent Acquisition Specialist
    📞+1 | ✉️
    🌐 | Intuitive Insights LLC

Will your resume get past this employer's screening? Check your resume against this job, free

Similar jobs