LLM-to-Flow Distillation adapts scientific generators to natural-language goals via DPO
Overview
ETH Zurich researchers and collaborators introduce LLM-to-Flow Distillation (LFD), a method that uses a frozen LLM to grade scientific generator outputs and distills those preferences into the generator through DPO. The authors say LFD needs no task-specific proxy rewards, works with any frontier LLM through API access, and outperforms reward-guided methods FlowGRPO and DiffusionNFT on held-out computational evaluations. The result is reported on drug-design generators, where the authors say the base model produced no usable hits in 38,500 samples before training. Rohan Paul, who reported the work on X, gives scores of 69.06 for LFD and 57.04 for the comparison method, figures that come from the paper rather than an independent check.
Written by AI from the articles below · updated Oct 15, 7:43 AM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
Rohan Paul@rohanpaul_aiXLLM-to-Flow Distillation teaches drug-design generators to follow plain-English goalsAIResearchers at ETH Zurich and collaborators introduce LLM-to-Flow Distillation (LFD), which uses a frozen LLM to judge generator outputs and distills those preferences into the generator through DPO. The paper reports that LFD beats FlowGRPO and DiffusionNFT on held-out computational evaluations without seeing real scoring functions. The author reports a result of 69.06 versus 57.04 and notes that the base model produced no usable hits in 38,500 samples before training.

Heat trend
Not enough continuous observations to show a trend yet.