Skip to content
Trending storyDeveloping

Meng Shao recommends Jiahui Huang's nine-part LLM training and inference video series

1 article1 sourcesince Oct 30Last article 1h ago ·

Overview

AISummary of 1 article

Meng Shao recommends a nine-episode, 230-minute YouTube series called "AI Training and Inference" by Jiahui Huang (@jbhuang0604), covering foundation model training and inference.

Shao says the series spans the full training and inference architecture, from single-GPU memory and optimizers through ZeRO, FSDP, five-dimensional parallelism, LoRA variants, speculative decoding, on-policy distillation, GRPO, AdamW and Muon.

Episode 9, LLM Serving (about 42 minutes), is member-only content. Shao says viewers can decide for themselves whether to study it after watching the first eight episodes. Huang's own post says he is still building the playlist and asks which other topics to add.

Written by AI from the articles below · updated Oct 30, 9:25 PM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 30
  1. meng shaoX
    Jiahui Huang's nine-part LLM training and inference video series is outlined

    AIMeng Shao outlines a nine-episode, 230-minute YouTube series by @jbhuang0604 called "AI Training and Inference," which covers model training and inference from single-GPU memory to optimizers. The episodes run from ZeRO and FSDP through five-dimensional parallelism, LoRA variants, speculative decoding, on-policy distillation, GRPO, AdamW, and Muon, with LLM serving reserved for member-only episode 9. Huang's background post says he is still building the playlist and asks what other topics to add.

    Image from @shao__meng's post

Heat Trend

Not enough continuous observations to show a trend yet.