Skip to content
Trending storyDeveloping

OpenRouter rebuilds provider routing to weigh speed and reliability alongside price

3 articles2 sourcessince Oct 27Last article 1h ago ·

Overview

AISummary of 3 articles

OpenRouter says its new provider routing algorithm picks endpoints by a real-time Routing Cost that combines effective price, waiting time and retry cost, rather than price alone.

In a one-week switchback experiment over 24 million requests, the company reports TTFT p50 fell 16.9%, throughput p50 rose 16.3%, and requests hitting a 429 error dropped 67%, while cost per K requests rose 6.0%.

Requests with no explicit provider sort and no provider order or ignore list use the new router automatically on models where it is enabled. Users who want the old price-only behavior can set provider.sort to "price", append :floor to the model slug, or set price as the default sort in account settings.

A follow-up X post from OpenRouter says the new router rewards providers that deliver the best-quality inference for a request's actual cost. The post does not add technical detail beyond the blog's description.

Written by AI from the articles below · updated Oct 29, 1:09 PM ET

Check the sources:

Developments

3 developments

  1. Oct 29, 1:06 PM ET · 1 article
    OpenRouter explains how it rebuilt its provider routing
    OpenRouter: OpenRouter explains how it rebuilt its provider routing
  2. Oct 29, 1:06 PM ET · 1 article
    OpenRouter ships new provider router that weights quality, speed and reliability alongside cost
    OpenRouter: OpenRouter overhauls its provider router to favor quality, speed and reliability
  3. Oct 27, 8:00 PM ET · 1 article
    OpenRouter rebuilds its provider routing algorithm to weigh speed and reliability alongside price
    OpenRouter Blog: OpenRouter rebuilds provider routing to weigh speed and reliability alongside price

Article timeline

The articles in this story. Times are ET.

Oct 29
  1. OpenRouterOfficial
    OpenRouter explains how it rebuilt its provider routing

    AIOpenRouter's announcement post links to a blog entry describing how the company rebuilt its provider routing. The post itself gives no technical details, so the summary cannot state what changed.

  2. OpenRouterOfficial
    OpenRouter overhauls its provider router to favor quality, speed and reliability

    AIOpenRouter says it has shipped its biggest improvement to its provider router since founding the company. The router previously prioritized mostly on price, but now rewards providers that deliver the best-quality inference for a request's actual cost, favoring speed and reliability alongside low prices.

    Image from @OpenRouter's post
Oct 27
  1. OpenRouter BlogOfficialPick
    OpenRouter rebuilds provider routing to weigh speed and reliability alongside price

    AIOpenRouter says its new provider routing algorithm picks endpoints by a real-time Routing Cost that combines effective price, waiting time and retry cost. In a one-week switchback experiment over 24 million requests, it cut TTFT p50 by 16.9%, raised throughput p50 by 16.3% and reduced requests hitting a 429 by 67%, at a 6.0% higher cost per K requests.

Heat Trend

Current comparable heat
10
Peak comparable heat
10Oct 29, 2:00 PM ET
Change in past 24 hours
–

The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.