Skip to content
Trending storyDeveloping

Unsloth adds native ARM64 Windows CUDA support on NVIDIA RTX Spark

2 articles2 sourcessince Oct 16Last article 1h ago ·

Overview

AISummary of 2 articles

Unsloth says its tools now run natively on ARM64 Windows with CUDA on NVIDIA RTX Spark laptops, for running and training diffusion, multimodal, language and decision models.

Unsloth says training on the platform is 2.7 times faster, a figure the company reports and that the reviewed reports have not independently measured. Users can install through winget or from unsloth.ai/download/windows.

In a separate post, Unsloth says RTX Spark lets users run and train models above 120 billion parameters locally on a laptop, with up to 128GB of unified memory. Its chart compares RTX Spark N1X with a premium SoC and shows 2.7x for fine-tuning with Unsloth.

Written by AI from the articles below · updated Oct 16, 8:25 PM ET

Check the sources:

Developments

2 developments

  1. Oct 16, 8:04 PM ET · 1 article
    Unsloth adds native ARM64 Windows CUDA support for RTX Spark, claiming 2.7x speedup
    Daniel Han: Unsloth adds native Windows ARM64 CUDA support on RTX Spark
  2. Oct 16, 7:54 PM ET · 1 article
    Unsloth announces local 120B+ model training and running on NVIDIA RTX Spark laptops
    Unsloth AI: Unsloth says NVIDIA RTX Spark can train 120B-plus models on a laptop

Article timeline

The articles in this story. Times are ET.

Oct 16
  1. Daniel HanX
    Unsloth adds native Windows ARM64 CUDA support on RTX Spark

    AIUnsloth says it now runs natively on ARM64 Windows with CUDA on NVIDIA RTX Spark, covering diffusion, multimodal, language, and decision models. The author reports training is 2.7x faster and gives winget or the Unsloth download page as install options.

    Image from @danielhanchen's post
  2. Unsloth AIOfficial
    Unsloth says NVIDIA RTX Spark can train 120B-plus models on a laptop

    AIUnsloth says NVIDIA RTX Spark lets users run and train models above 120B parameters locally on a laptop. The post says training diffusion, decision and multimodal models runs about 2.7 times faster with CUDA on ARM, with up to 128GB of unified memory. The attached chart compares RTX Spark N1X with a premium SoC, showing 2.7x for fine-tuning with Unsloth.

    Image from @UnslothAI's post

Heat trend

Not enough continuous observations to show a trend yet.