Skip to content
Trending storyMonitoring

Santiago explains YaFSDP, an open-source tool for faster multi-GPU LLM training

1 article1 sourcesince Nov 12Last article

Overview

AISummary of 1 article

Santiago, on X, explains YaFSDP, an open-source tool for training large language models across multiple GPUs.

He says it reuses memory and transfers model data while the GPUs run other calculations, which makes training faster.

Yandex says that training Llama 3 70B on 256 A100 GPUs took about 26% less time than with PyTorch FSDP. The 26% figure comes from Yandex, not from Santiago's post.

Written by AI from the articles below · updated Nov 12, 11:57 AM ET

Check the sources:

Latest developmentNov 12, 11:45 AM ET
Santiago explains YaFSDP, an open-source tool for faster multi-GPU LLM training

Article timeline

The articles in this story. Times are ET.

Nov 12
  1. SantiagoX
    Santiago explains YaFSDP, an open-source tool for faster multi-GPU LLM training

    AISantiago describes YaFSDP, an open-source tool for training large language models across multiple GPUs. It reuses memory and transfers model data while GPUs run other calculations, which speeds up training. Yandex says training Llama 3 70B on 256 A100 GPUs took about 26% less time than with PyTorch FSDP.

Heat Trend

Current comparable heat
4
Peak comparable heat
10Nov 12, 12:00 PM ET
Change in past 24 hours
-50%

The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.