Skip to content

Respan launches an open-source Rust AI gateway built around plugins

AIRespan, a Y Combinator W24 company, has launched an open-source Rust AI gateway in which providers, protocols, and features are all plugins around a small core. The team says its earlier gateway, built on LiteLLM, grew past 100,000 lines of wrapper code and that a routine LiteLLM upgrade caused connection errors, prompting a redesign.

AIWhy it matters.

The post explains why the team moved from patching LiteLLM to a plugin-based core, giving a concrete case for the architecture choice.

Read the original news.ycombinator.com
Source details

Hacker News · Launch HN, YC launches (10+ points) · Andydy25 · news.ycombinator.comPublished · added here

Original title: Launch HN: Respan (YC W24) – Open-source Rust AI gateway built around plugins