Databricks releases Funke, a Python/PySpark library that parses HL7v2 healthcare messages natively
Overview
Databricks has released Funke, an open-source Python and PySpark library and deployable pipeline that parses HL7v2 healthcare messages into native Spark types while preserving the full message hierarchy.
Funke succeeds Smolder, the Scala data source Databricks open-sourced in 2021, and is rebuilt for the current Databricks platform. According to the Databricks blog, it ingests messages through Auto Loader into Unity Catalog bronze and silver tables, and users can query segments, fields, components, and subcomponents directly with DataFrame or Spark SQL expressions. Funke is distributed under the Databricks License.
Written by AI from the articles below · updated Oct 8, 7:52 PM ET
Check the sources:
Article timeline
Follow the coverage from different perspectives. Times are ET.
- Databricks BlogFunke Brings Native HL7v2 Parsing to Databricks Lakehouse
AIDatabricks has released Funke, a Python and PySpark library and deployable pipeline that parses HL7v2 healthcare messages into native Spark types while preserving the full message hierarchy. It succeeds Smolder, the Scala data source Databricks open-sourced in 2021, and ingests through Auto Loader into Unity Catalog bronze and silver tables. Users can query segments, fields, components, and subcomponents directly with DataFrame or Spark SQL expressions.
Heat trend
Not enough continuous observations to show a trend yet.