Skip to content
View original post on X: Lewis Tunstall
Published
43/100

Mid-training lifts Qwen3-14B's learning signal from 17% to 42% of prompts

AILewis Tunstall says an off-the-shelf Qwen3-14B produced a learning signal on 17% of prompts. After mid-training on 300B tokens of DNA and text, that share rose to 42%.
Lewis TunstallVerified on X
@_lewtun
View on X

Part of a thread · earlier post

Btw none of this works unless the model already knows something about the domain.

Off the shelf, Qwen3-14B gave a learning signal on 17% of our prompts. After mid-training on 300B tokens of DNA and text, 42%

Source details

Lewis Tunstall · x.comPublished

Original title: Btw none of this works unless the model already knows something about the domain.