Skip to content
Trending storyDeveloping

Prime Inference reports 96.9% cache hit rate for Nemotron 3.5 Super VL

1 article1 sourcesince Nov 2Last article 1h ago ·

Overview

AISummary of 1 article

Prime Intellect says its Prime Inference service has a 96.9% cache hit rate for Nemotron 3.5 Super VL, the highest of any provider serving that model.

Prime Intellect says the rate brings Prime Inference's effective input cost to $0.024 per million tokens, the lowest of any provider and about 70% below the largest provider. The claim comes from a Prime Intellect post on X dated November 2, 2026, and no independent figures are reported.

Written by AI from the articles below · updated Nov 2, 7:27 PM ET

Check the sources:

Article timeline

The articles in this story. Times are ET.

Nov 2
  1. Prime IntellectOfficial
    Prime Intellect's Prime Inference posts top cache hit rate for Nemotron 3.5 Super VL

    AIPrime Inference reports a 96.9% cache hit rate, the highest of any provider serving Nemotron 3.5 Super VL. That brings its effective input cost to $0.024 per million tokens, the lowest of any provider and about 70% below the largest one.

    Image from @PrimeIntellect's post

Heat Trend

Not enough continuous observations to show a trend yet.