Databricks Data Engineer SME - Clearance Required with Security Clearance

Overview LMI is a new breed of digital solutions provider dedicated to accelerating government impact with innovation and speed. Investing in technology and prototypes ahead of need, LMI brings commercial-grade platforms and mission-ready AI to federal agencies at commercial speed. Leveraging our mission-ready technology and solutions, proven expertise in federal deployment, and strategic relationships, we enhance outcomes for the government, efficiently and effectively.

With a focus on agility and collaboration, LMI serves the defense, space, healthcare, and energy sectors-helping agencies navigate complexity and outpace change. Headquartered in Tysons, Virginia, LMI is committed to delivering impactful results that strengthen missions and drive lasting value.

LMI is seeking a skilled Databricks Data Engineer SME (DHA RevOS / Databricks, War Data Platform && Data Visualization) to serve as a senior technical lead responsible for designing, restructuring, and implementing the data foundation required for the Defense Health Agency (DHA) Revenue Cycle Operating System ( RevOS ).

This role will work directly within a Databricks-based War Data Platform (WDP) environment to assess existing DHA revenue-cycle data structures, identify architectural and data-quality deficiencies, and redesign those structures into a scalable, governed, and reusable revenue-cycle data model.

The primary objective is to establish a connected data architecture representing the actual healthcare revenue-cycle workflow: Scheduling → Eligibility → Registration → Authorization → Patient Care → Documentation → Coding → Charge Capture → Claim → Adjudication → Payment → Denial → Follow-Up → Recovery The Senior Data Engineer SME will ensure DHA's existing data is reorganized around this workflow so individual encounters, charges, codes, claims, payments, denials, and recovery activities can be connected and traced through the entire revenue lifecycle.

The individual will also be responsible for ensuring the resulting Databricks data architecture directly supports production dashboards, operational visualizations, RevOS SITREP views, KPI reporting, and drill-down analysis . In addition, this candidate will have demonstrated experience in collaborating with other data engineers and data scientists, and effective communication with clients. Responsibilities

• Lead the technical design and implementation of the RevOS data architecture within Databricks and the DHA War Data Platform .
• Assess and remediate DHA's existing revenue-cycle data structures, including fragmented schemas, duplicate entities, inconsistent definitions, missing relationships, weak keys, data-quality issues, reconciliation problems, and structures that do not align to the operational workflow.
• Develop a target-state canonical revenue-cycle data model connecting beneficiary/patient, encounter, appointment, eligibility, authorization, provider, MTF, documentation, diagnosis, procedure, coding, charge, claim, claim line, payer, adjudication, remittance , payment, adjustment, denial, AR, appeal, follow-up, and recovery opportunity.
• Design and implement the Databricks Bronze → Silver → Gold architecture for RevOS .
• Design Gold data products and analytical data marts specifically optimized to support Databricks dashboards and visualization workloads .
• Develop and maintain Databricks SQL dashboards, AI/BI dashboards, and native visualization capabilities supporting operational, financial, revenue-recovery, and executive users.
• Build reusable semantic datasets and optimized SQL structures that allow dashboards to consistently calculate RevOS KPIs across enterprise, DHN, MTF, department, provider, encounter, and claim levels.
• Ensure dashboard queries and Gold datasets are optimized for performance, refresh cadence, scalability, and concurrent users.
• Configure dashboard-level access consistent with Unity Catalog permissions, row-level security, column-level security, PHI/PII requirements, and user roles.
• Support dashboard drill-down from summary Healthy / At Risk / Critical indicators into underlying record-level exceptions and work queues.
• Profile Government-furnished Bronze datasets and develop source-to-target mappings.
• Normalize and conform data from MHS GENESIS Millennium, Abacus, and other approved sources.
• Develop reusable Silver-layer entities with common keys, normalized timestamps, enterprise reference dimensions, and standardized business definitions.
• Build Gold products supporting:
• Revenue-cycle KPIs
• Coding-audit financial impact
• Charge completeness
• Claims readiness
• Days-to-Bill
• Denial management
• Payer performance
• Payment/remittance reconciliation
• Underpayment detection
• AR aging
• Revenue recovery
• Audit and NFR traceability
• Design the data model supporting the Revenue Opportunity Ledger and associated recovery work queues.
• Establish entity-resolution methodologies connecting records across disparate source systems.
• Develop deterministic and, where appropriate , probabilistic matching for encounters, claims, charges, payments, providers, payers, and related entities.
• Develop and maintain ODCS-based machine-readable data contracts .
• Implement automated quality contr ols addressing completeness, uniqueness, referential integrity, schema conformity, temporal integrity, code validity, financial reconciliation, and source-to-target consistency.
• Establish automated Bronze-to-Silver and Silver-to- Gold quality gates.
• Build reconciliation contr ols across billed, allowed, paid, adjusted, patient-responsibility, AR, and recovery values.
• Configure and manage Databricks Unity Catalog , including catalog/schema design, classification, tagging, ownership, lineage, row/column security, and access contr ols.
• Support enterprise metadata federation and DHA data-governance requirements.
• Develop scalable Delta Lake structures and optimize partitioning, clustering, SQL performance, storage, and compute usage.
• Develop Databricks jobs, workflows, orchestration, production monitoring, alerting, and error-handling processes.
• Version-contr ol pipeline code, transformations, data contracts, configurations, and infrastructure-as-code using Government-furnished GitLab.
• Support automated CI/CD and contr olled production promotion.
• Partner with Data Scientists and Analytics Engineers to support predictive modeling, payer analytics, recovery scoring, anomaly detection, and dashboard requirements.
• Partner with Revenue Cycle and Coding SMEs to translate hospital revenue-cycle workflows into executable data structures and business rules.
• Develop source-to-target documentation, data dictionaries, lineage artifacts, architecture diagrams, runbooks, and sustainment documentation.
• Mentor Data Engineers and establish reusable Databricks engineering and visualization patterns across the RevOS environment. Qualifications
• Active SECRET Clearance
• Bachelor's Degree and 10+ years of experience in enterprise data engineering, data architecture, data platform development, or related disciplines.
• Senior/SME-level hands-on experience with Databricks .
• Demonstrated experience using Databricks visualization and dashboard capabilities , including Databricks SQL and/or AI/BI dashboards.
• Ability to design the underlying Gold/semantic data structures required for enterprise-scale dashboards and operational reporting.
• Experience creating and optimizing SQL queries, datasets, and views that support interactive visualization and drill-down.
• Strong experience with:
• Apache Spark / PySpark
• SQL
• Python
• Delta Lake
• ETL / ELT
• Data pipeline orchestration
• Large-scale data transformation
• Demonstrated experience implementing Bronze / Silver / Gold medallion architectures .
• Strong experience designing normalized and analytical data models for complex enterprise environments.
• Demonstrated ability to evaluate and redesign or remediate poorly structured existing data environments , rather than simply building additional pipelines on top of them.
• Experience designing canonical data models, conformed dimensions, enterprise keys, entity resolution, and reusable semantic structures.
• Strong knowledge of data-quality engineering, financial reconciliation, metadata, lineage, and data governance.
• Experience with Databricks Unity Catalog or equivalent enterprise data-governance/catalog technology.
• Experience building production-grade pipelines with automated testing, monitoring, logging, failure handling, and CI/CD.
• Ability to translate operational workflows into logical and physical data architectures and visualization-ready products.
• Experience supporting highly regulated, healthcare, financial, or Government environments.
• Ability to work with PHI, PII, CUI, and other contr olled data under applicable security and privacy requirements.
• Ability to work across engineering, analytics, visualization, cybersecurity, product, architecture, and business-SME teams.
• Ability to meet applicable DHA/DoD security, privacy, access, and data-handling requirements.

Preferred Qualifications

• Prior experience with Advana and/or the current War Data Platform (WDP) .
• Direct experience developing Databricks data products and dashboards in a DoD enterprise environment.
• Experience with DHA, MHS, or other DoD healthcare data.
• Experience with MHS GENESIS / Oracle Health/Cerner Millennium and/or Abacus.
• Healthcare revenue-cycle data experience involving encounters, coding, charge capture, claims, denials, adjudication, remittance, payments, AR, and revenue recovery.
• Familiarity with healthcare EDI transactions including 837, 835, 270/271, 276/277, and 278.
• Experience implementing Open Data Contract Standard (ODCS) or comparable machine-readable contracts.
• Experience with GitLab-based DevSecOps , infrastructure-as-code, automated testing, and secure promotion.
• Familiarity with Col li bra or comparable enterprise data catalogs.
• Experien