Skip to content
Trending storyDeveloping

Nathan Lambert says team structure outweighs compute in building LLMs

2 articles2 sourcessince Oct 27Last article

Overview

AISummary of 2 articles

Nathan Lambert says on X that org charts and team functioning are underrated in building a good LLM, and that an effective organization is worth several times more than extra compute.

He argues models have little secret sauce, and that most gains come from consistent execution and wise use of compute. The report includes no supporting data or examples.

A later post by Dongxi NLP, a separate X account, shares five lessons on managing teams that train frontier AI models. It recommends keeping core language modeling teams small as companies grow, training fewer, more capable models on a fixed schedule, and having engineering serve the next model rather than sit apart from training.

Written by AI from the articles below · updated Oct 27, 6:21 PM ET

Check the sources:

Developments

2 developments

  1. Oct 27, 5:59 PM ET · 1 article
    Dongxi NLP shares five lessons on managing frontier AI training teams
    Dongxi NLP: Dongxi NLP shares five lessons on managing frontier AI training teams
  2. Oct 27, 2:02 PM ET · 1 article
    Nathan Lambert says team structure matters more than compute for LLMs
    Nathan Lambert: Nathan Lambert says team structure matters more than compute for LLMs

Article timeline

The articles in this story. Times are ET.

Oct 27
  1. Dongxi NLPX
    Dongxi NLP shares five lessons on managing frontier AI training teams

    AIDongxi NLP shares notes on managing teams that train frontier AI models, including keeping core language modeling teams small even as companies expand. The post recommends fewer, more capable models trained on a fixed schedule, and says engineering must serve the next model rather than be split from training.

  2. Nathan LambertX
    Nathan Lambert says team structure matters more than compute for LLMs

    AINathan Lambert says org charts and team functionality are underrated in building a good LLM, and that an effective org is worth multiple multiples in compute. He argues models have little secret sauce, with most gains coming from consistent execution and wise use of compute.

    Image from @natolambert's post

Heat Trend

Current comparable heat
13
Peak comparable heat
19Oct 27, 6:00 PM ET
Change in past 24 hours
–

The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.