🛠️ We built open OpenRouter that turns usage into a better model
Summary
An open-source model gateway written in Rust that manages self-hosted, frontier, and open-source models in one place. It handles provider quirks, adds minimal latency, supports over a thousand models, and uses usage data to optimize routing and train custom models.
Why it’s interesting
It is an open-source alternative with no token markup that uses OTel traces and simulations to optimize routing and train models from usage data.
Target user
Developers and organizations managing multiple AI model providers and self-hosted models.
Business model
Open source with a hosted version offering zero markup.
Source metrics: Points 8 · Comments 0
HN discussion · Project
Source: #HackerNews / Show HN
Summary
An open-source model gateway written in Rust that manages self-hosted, frontier, and open-source models in one place. It handles provider quirks, adds minimal latency, supports over a thousand models, and uses usage data to optimize routing and train custom models.
Why it’s interesting
It is an open-source alternative with no token markup that uses OTel traces and simulations to optimize routing and train models from usage data.
Target user
Developers and organizations managing multiple AI model providers and self-hosted models.
Business model
Open source with a hosted version offering zero markup.
Source metrics: Points 8 · Comments 0
HN discussion · Project
Source: #HackerNews / Show HN