Skip to content
Trending storyDeveloping

LLM-to-Flow Distillation adapts scientific generators to natural-language goals via DPO

1 article1 sourcesince Oct 15Last article 1h ago ·

Overview

AISummary of 1 article

ETH Zurich researchers and collaborators introduce LLM-to-Flow Distillation (LFD), a method that uses a frozen LLM to grade scientific generator outputs and distills those preferences into the generator through DPO. The authors say LFD needs no task-specific proxy rewards, works with any frontier LLM through API access, and outperforms reward-guided methods FlowGRPO and DiffusionNFT on held-out computational evaluations. The result is reported on drug-design generators, where the authors say the base model produced no usable hits in 38,500 samples before training. Rohan Paul, who reported the work on X, gives scores of 69.06 for LFD and 57.04 for the comparison method, figures that come from the paper rather than an independent check.

Written by AI from the articles below · updated Oct 15, 7:43 AM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 15
  1. Rohan PaulX
    LLM-to-Flow Distillation teaches drug-design generators to follow plain-English goals

    AIResearchers at ETH Zurich and collaborators introduce LLM-to-Flow Distillation (LFD), which uses a frozen LLM to judge generator outputs and distills those preferences into the generator through DPO. The paper reports that LFD beats FlowGRPO and DiffusionNFT on held-out computational evaluations without seeing real scoring functions. The author reports a result of 69.06 versus 57.04 and notes that the base model produced no usable hits in 38,500 samples before training.

    Image from @rohanpaul_ai's post

Heat trend

Not enough continuous observations to show a trend yet.