Skip to content
View original post on X: Dongxi NLP
Published
25/100

Dongxi NLP explains reward models as the inverse of Bradley-Terry

AIDongxi NLP says reward models are the inverse of the Bradley-Terry model, in the fifth part of its Post Training series. The post plans to cover how preference choices become a loss, how that loss updates the network, the network's architecture, and what the reward model learns during training.
Dongxi NLPVerified on X
@dongxi_nlp
View on X

Post Training 系列第五篇,Reward Model

如题目,Reward Model 是 Bradley-Terry 的倒影。

选择怎样变成损失,
损失怎样改变网络,
网络长什么样,
RM 在训练中还学到了什么

( 依然非常干...

Dongxi 东锡 NLP@dongxi_nlp
https://x.com/i/article/2116301274433961984
View quoted post on X
Source details

Dongxi NLP · x.comPublished · added here

Original title: Post Training 系列第五篇,Reward Model