OpenRouter and Mercor host talk on choosing AI models with evals

OpenRouter announces a New Defaults conversation between its Chris Clark and Mercor's Osvald Nitski on how evals help teams decide when to optimize, switch models, or train their own.

The post presents model choice as a trade-off among accuracy, cost, and latency, as inference bills rise. The announcement gives no benchmark results, prices, or specific eval methods.