Tag: vllm
All the articles with the tag "vllm".
-
Streaming Journals: Kafka Meets LLMs
The automated journal entries were fiction. Every single one. Here's how a broken pipeline got replaced in 10 days — Kafka, vLLM workers, nine code iterations, a context preservation fix, and an LLM-as-Judge quality gate — all tracked through git commits and vault evidence.
-
The Migration Question: When K3s Meets Reality
K3s was already running. The question wasn't whether to use it - it was whether to migrate everything to it. A day of deep research revealed the hidden cost of containerization.