Must-read report! They find that LLMs are surprisingly good at reading and writing neural network weights.
Huge for RSI when you think about it!
Current RSI pipelines focus on writing code to launch training jobs.
This capability could offer a more native path to recursively self-improve models via weights.
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math. It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training. We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵 Blog: https://rikiyat.github.io/blog/weight-space-programming/
elvis · x.comPublished · added here
Original title: Must-read report! They find that LLMs are surprisingly good at reading and writing neural network weights.
