Skip to content
View original post on X: Rohan Paul
Published
62/100

Post-trained Qwen3.8-27B cuts AA-Omniscience hallucinations from 30.4% to 15.1%

AIRohan Paul shares results for an RL post-trained Qwen3.8-27B model trained with open-source environments. The model cuts the hallucination rate on AA-Omniscience from 30.4% to 15.1%, and its compressed MLA version fits on a single 24 GB RTX 4090 with about 3.5x more context than base Qwen.
Rohan PaulVerified on X
@rohanpaul_ai
View on X

Some of the most interesting agent results this year are coming out of post-trains of small open models.

A new RL post-train Qwen3.8-27B model trained with an open-source environments cuts the hallucination rate on AA-Omniscience from 30.4% to 15.1%.

the compressed copy of the mla version fits on my single 24 GB RTX 4090 and holds about 3.5x more context than base Qwen.

It beats GPT 6 Luna-medium on DeepSWE, placing in between Luna 6 medium and high.
scores higher on Terminal-Bench 2.1 while writing a median 23.8K output tokens per solved task, where base Qwen writes 54.9K.

Tried an unreleased version of this model, and really felt the comparative intelligent density, that it writes a lot less.

tops Muse Glimmer 30B and OpenAI’s GPT-6 Luna (high) on Terminal-Bench, τ³-bench, ClawEval and BFCL v4 (Berkeley Function Calling Leaderboard), though Luna still wins DeepSWE at 53.1%.

They also released an MLA version, which is the same model with its 16 full-attention layers converted to multi-head latent attention, which shrinks the memory each token takes from 64 KiB to 18 KiB so far more or longer sessions fit on one GPU.

Source details

Rohan Paul · x.comPublished · added here

Original title: Some of the most interesting agent results this year are coming out of post-trains of small open models.