Respan launches open-source Rust AI gateway built around plugins
Overview
Respan, a Y Combinator W24 company, has launched an open-source AI gateway written in Rust in which providers, protocols, modalities and gateway features are all plugins around a small core.
The plugins named include providers, MCP and voice protocols, image and video modalities, and features such as fallbacks, PII redaction and smart routing.
The team says its earlier gateway, built on LiteLLM, grew past 100,000 lines of wrapper code, and that a routine LiteLLM upgrade caused connection errors, which prompted the redesign.
Written by AI from the articles below · updated Oct 20, 12:16 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
- Hacker News · Launch HN, YC launches (10+ points)BlogRespan launches an open-source Rust AI gateway built around plugins
AIRespan, a Y Combinator W24 company, has launched an open-source Rust AI gateway in which providers, protocols, and features are all plugins around a small core. The team says its earlier gateway, built on LiteLLM, grew past 100,000 lines of wrapper code and that a routine LiteLLM upgrade caused connection errors, prompting a redesign.
Heat Trend
Not enough continuous observations to show a trend yet.