Chris Remo

If you're running LLMs in production, you've probably evaluated LiteLLM. It's the most popular gateway out there - 100+ providers, massive community, used by companies like Stripe and Netflix. I built VoidLLM with a different set of priorities. Here's an honest comparison - including where LiteLLM is ahead. Why I built something different We were running self-hosted models in Kubernetes, hitting vLLM directly. No proxy, network policies were the only access control.

If you've worked with LLMs and tool use, you know the pattern. The model decides it needs to call a tool. It emits a tool call. Your system executes it, returns the result. The model reads the result, reasons about it, and decides it needs another tool call. Repeat. Every round trip burns tokens. The model re-reads the entire conversation history each time.

Thanks for opting in to updates about my work! I’m pleased to let you know that iam8bit, known for their high-quality video game-related merchandise, is releasing a new vinyl record of my original soundtrack to the classic narrative adventure game Gone Home, in honour of the tenth anniversary of its release. This will be a limited run, and preorders begin tomorrow, 19 October, at 9am Pacific/Noon Eastern/5pm UK.