🛠️ QueenMQ – slow LLM calls blocked our Kafka partitions, so we built it
Summary
QueenMQ is an open source message broker built in Rust with Raft replication designed to solve head-of-line blocking issues in slow LLM and messaging pipelines. It combines queue features like ACKs and retries with dynamic partitions, database transactions, and a linearizable KV store.
Why it’s interesting
It was created to solve Kafka head-of-line blocking caused by slow LLM calls, supporting up to 10 million dynamic partitions and replacing outbox tables and cron jobs.
Target user
Developers and engineers building messaging systems or LLM applications who experience head-of-line blocking with traditional message brokers.
Source metrics: Points 3 · Comments 0
HN discussion · Project
Source: #HackerNews / Show HN
Summary
QueenMQ is an open source message broker built in Rust with Raft replication designed to solve head-of-line blocking issues in slow LLM and messaging pipelines. It combines queue features like ACKs and retries with dynamic partitions, database transactions, and a linearizable KV store.
Why it’s interesting
It was created to solve Kafka head-of-line blocking caused by slow LLM calls, supporting up to 10 million dynamic partitions and replacing outbox tables and cron jobs.
Target user
Developers and engineers building messaging systems or LLM applications who experience head-of-line blocking with traditional message brokers.
Source metrics: Points 3 · Comments 0
HN discussion · Project
Source: #HackerNews / Show HN