Skip to content
Trending storyDeveloping

Qwen3.8-27B post-train cuts AA-Omniscience hallucinations to 15.1% with MLA variant

1 article1 sourcesince Oct 20Last article 2h ago ·

Overview

AISummary of 1 article

An unnamed developer releases an RL post-trained Qwen3.8-27B model that cuts the hallucination rate on AA-Omniscience from 30.4% to 15.1%, according to results shared by Rohan Paul on X. The post-train uses open-source environments.

The developer also releases an MLA version, the same model with its 16 full-attention layers converted to multi-head latent attention, which shrinks per-token memory from 64 KiB to 18 KiB.

Rohan Paul says the compressed MLA version fits on a single 24 GB RTX 4090 with about 3.5x more context than base Qwen. He also reports that the model beats GPT-6 Luna-medium on DeepSWE, while Luna still scores higher at 53.1%. On Terminal-Bench 2.1 the model scores higher than base Qwen, with a median of 23.8K output tokens per solved task versus 54.9K for base Qwen.

Written by AI from the articles below · updated Oct 20, 10:37 AM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Oct 20
  1. Rohan PaulX
    Post-trained Qwen3.8-27B cuts AA-Omniscience hallucinations from 30.4% to 15.1%

    AIRohan Paul shares results for an RL post-trained Qwen3.8-27B model trained with open-source environments. The model cuts the hallucination rate on AA-Omniscience from 30.4% to 15.1%, and its compressed MLA version fits on a single 24 GB RTX 4090 with about 3.5x more context than base Qwen. It beats GPT-6 Luna-medium on DeepSWE, scores higher on Terminal-Bench 2.1 with a median of 23.8K output tokens per solved task versus 54.9K for base Qwen, but Luna still wins DeepSWE at 53.1%.

Heat Trend

Not enough continuous observations to show a trend yet.