# Rock Matrix open-sources EdgeRock-4B, a 4B model with fixed-size memory

> Original title: Rock Matrix has open-sourced EdgeRock-4B, a small text-and-image reasoning model with fixed-capacity memory.

- Source: Testing Catalog
- Published: 2026-10-31T12:01:23.000Z
- Bad Influence: https://badinfluence.news/items/o31kz9sknvdntl6v4pt8mpgbi
- Original: https://x.com/testingcatalog/status/2116500778814697819

## Summary

Rock Matrix has open-sourced EdgeRock-4B, a small text-and-image reasoning model that keeps its attention KV cache fixed in size. The model holds the last 1,024 tokens in full and stores important older details in a separate bank, so memory use does not grow with long chats or long reasoning. Rock Matrix reports 82.9% mean pass@1 on AIME 2024–2026, compared with 18.8% for the strongest bounded-state model it tested.

## Post

Rock Matrix has open-sourced EdgeRock-4B, a small text-and-image reasoning model with fixed-capacity memory.

EdgeRock-4B keeps its attention KV cache fixed in size by holding the last 1,024 tokens in full and saving important older details to a separate bank. 

Standard language models keep a growing record of every token they read, so long chats and long reasoning take up more GPU memory over time. 

Rock Matrix reports an 82.9% mean pass@1 on AIME 2024–2026, compared to 18.8% for the strongest bounded-state model it tested.

![](https://badinfluence.news/api/img-proxy?u=https%3A%2F%2Fpbs.twimg.com%2Fmedia%2FHV9SPTQXsAEkP7_.jpg&mode=thumb&exp=1793664000&sig=8eb298f84d0c6cfe)