https://thelastguardian.me/tags/gpu/Recent content in Gpu on thelastguardian.meHugo -- gohugo.ioen-usSat, 16 May 2026 00:00:00 +0000https://thelastguardian.me/posts/2026-05-16-an-amd-r9700-for-local-inference/Sat, 16 May 2026 00:00:00 +0000https://thelastguardian.me/posts/2026-05-16-an-amd-r9700-for-local-inference/<p>If a local model was going to be part of the assistant, I wanted to understand the machine under it. So I bought a AI-oriented GPU.</p> <p>I wanted to learn the internals of LLMs and inference, and I can&rsquo;t afford the multi-million-dollar racks of datacenter GPUs the hyperscalers run. A local model is a temporary stand-in for that learning: not smart enough to replace a frontier model, not some AGI/ASI waking up in my utility room, but decent enough to test chatting flows and scripts and watch how serving behaves.</p>