🛠️ Log every LLM call with tokens, cost, latency, and time to first token
Summary
Llmtee is a lightweight LLM proxy designed to log LLM calls including tokens, cost, latency, and time to first token. It runs as a single binary and passes traffic through chunk by chunk while storing usage data in an SQLite database.
Why it’s interesting
It offers a lightweight proxy alternative that requires no complex database setup or SDKs, operating with a tiny ~25 MB container image and ~40 MB memory footprint.
Target user
Developers building AI agents who need to log and monitor LLM calls.
Source metrics: Points 4 · Comments 0
HN discussion · Project
Source: #HackerNews / Show HN
Summary
Llmtee is a lightweight LLM proxy designed to log LLM calls including tokens, cost, latency, and time to first token. It runs as a single binary and passes traffic through chunk by chunk while storing usage data in an SQLite database.
Why it’s interesting
It offers a lightweight proxy alternative that requires no complex database setup or SDKs, operating with a tiny ~25 MB container image and ~40 MB memory footprint.
Target user
Developers building AI agents who need to log and monitor LLM calls.
Source metrics: Points 4 · Comments 0
HN discussion · Project
Source: #HackerNews / Show HN