Skip to content
Trending storyDeveloping

Microsoft explains running Qwen3.8-27B locally with Foundry Local and GitHub Copilot

1 article1 sourcesince Nov 5Last article 1h ago ·

Overview

AISummary of 1 article

Microsoft explains how to connect Foundry Local to GitHub Copilot using Bring Your Own Key (BYOK), so developers can run the Qwen3.8-27B model locally for coding.

The setup requires an NVIDIA GPU with at least 24 GB of VRAM and Foundry Local CLI 0.13.0 or later. CUDA and compatible cuDNN runtimes must be installed separately, because Foundry Local does not download them.

In Microsoft's comparison with llama.cpp on an RTX 5090 and a DGX Spark, Foundry Local generated text faster at every tested prompt length, with speedups from 1.36x to 1.95x shown in the chart.

Written by AI from the articles below · updated Nov 5, 9:05 AM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Nov 5
  1. Microsoft Foundry BlogOfficial
    Microsoft explains how to run Qwen3.8-27B locally with Foundry Local and GitHub Copilot

    AIMicrosoft explains how to connect Foundry Local to GitHub Copilot using Bring Your Own Key so developers can run Qwen3.8-27B on an NVIDIA GPU with at least 24 GB of VRAM. The required setup is Foundry Local CLI 0.13.0 or later, with CUDA and cuDNN runtimes installed separately. In its comparison with llama.cpp on an RTX 5090 and a DGX Spark, Foundry Local produced faster generation at every tested prompt length, with speedups from 1.36x to 1.95x in the chart.

Heat Trend

Not enough continuous observations to show a trend yet.