Funke Brings Native HL7v2 Parsing to Databricks Lakehouse
Original titleIntroducing Funke: Native HL7v2 Parsing on Databricks
AISummary
Databricks has released Funke, a Python and PySpark library and deployable pipeline that parses HL7v2 healthcare messages into native Spark types while preserving the full message hierarchy.
It succeeds Smolder, the Scala data source Databricks open-sourced in 2021, and ingests through Auto Loader into Unity Catalog bronze and silver tables.
Users can query segments, fields, components, and subcomponents directly with DataFrame or Spark SQL expressions.
Source: Databricks Blog · databricks.comPublished · added here