https://thelastguardian.me/tags/llm/Recent content in Llm on thelastguardian.meHugo -- gohugo.ioen-usSat, 16 May 2026 00:00:00 +0000https://thelastguardian.me/posts/2026-05-16-an-amd-r9700-for-local-inference/Sat, 16 May 2026 00:00:00 +0000https://thelastguardian.me/posts/2026-05-16-an-amd-r9700-for-local-inference/<p>If a local model was going to be part of the assistant, I wanted to understand the machine under it. So I bought a AI-oriented GPU.</p> <p>I wanted to learn the internals of LLMs and inference, and I can&rsquo;t afford the multi-million-dollar racks of datacenter GPUs the hyperscalers run. A local model is a temporary stand-in for that learning: not smart enough to replace a frontier model, not some AGI/ASI waking up in my utility room, but decent enough to test chatting flows and scripts and watch how serving behaves.</p>https://thelastguardian.me/posts/2026-01-25-homelab-2026-the-two-datacenters/Sun, 25 Jan 2026 00:00:00 +0000https://thelastguardian.me/posts/2026-01-25-homelab-2026-the-two-datacenters/Six years since the last post. The lab grew up - two sites on two continents, two Kubernetes clusters, GitOps everywhere, NixOS everywhere, and a GPU that talks back. A tour of what runs today and why.