Cloudflare cut its AI code reviewer's inference cost 68% through prompt caching and model tuning

Cloudflare says its AI code reviewer's average cost fell from $2.43 to $0.77 per review, while median review time dropped from 4m 09s to 1m 32s. The post attributes about 40% of the savings to changes in reviewer code and the rest to model and effort choices. It also reports that critical and warning findings fell, but that some real performance findings were lost at medium effort.