🛠️ Slash-tokens – know LLM cost before the call leaves your machine
Summary
Slash-tokens is a 4.8KB WebAssembly module that estimates tokens quickly and locally before an LLM call is made. It can block wasted trips or switch to a cheaper model on the same provider before the request leaves your machine.
Why it’s interesting
It allows developers to know and control LLM costs locally before a request is sent.
Target user
Developers working with LLM APIs
Business model
Open source
Source metrics: Points 4 · Comments 4
HN discussion · Project
Source: #HackerNews / Show HN
Summary
Slash-tokens is a 4.8KB WebAssembly module that estimates tokens quickly and locally before an LLM call is made. It can block wasted trips or switch to a cheaper model on the same provider before the request leaves your machine.
Why it’s interesting
It allows developers to know and control LLM costs locally before a request is sent.
Target user
Developers working with LLM APIs
Business model
Open source
Source metrics: Points 4 · Comments 4
HN discussion · Project
Source: #HackerNews / Show HN