ROCm vs Vulkan for AMD Local LLM Hosting: 2026 Guide
Choose the right AMD backend per engine
ROCm and Vulkan both accelerate AMD GPUs for local LLM hosting, but they are not interchangeable. The right choice depends on the engine, GPU, and workload.
Choose the right AMD backend per engine
ROCm and Vulkan both accelerate AMD GPUs for local LLM hosting, but they are not interchangeable. The right choice depends on the engine, GPU, and workload.
Why 128K context dies on 16 GB
A model can advertise a 128K context window and still fail at 40K tokens on a 16 GB GPU. The architecture ceiling never promised that weights, KV cache, compute buffers, and the desktop compositor would fit on your card at the same time.
What comes after LLMs? The post-transformer era.
AI hype follows a rhythm: roughly every three years, the architecture everyone is betting on gets replaced by something newer. The next shift is already forming in research labs.
OpenCode from the command line, in practice
OpenCode’s command-line interface is built for scripting, CI pipelines, and unattended agent runs. This article is a practical guide to using it in daily work.
Enforced SDD skills, installed in one command.
Superpowers packages a full spec-driven methodology into installable Claude Skills, enforcing brainstorming, planning, subagent-driven implementation, and strict TDD instead of leaving that structure up to you.
A small coding agent that expects you to shape it.
Pi Coding Agent is a minimal, open-source terminal coding harness that ships with four default tools and leaves most of the behaviour to extensions, skills and your own workflow.
Why your AI stack gets stickier every month.
Every API call feels like a simple transaction - until enough of them accumulate that your fine-tuning data, evaluation harnesses, and tool schemas are all shaped around one vendor, and switching stops being a routing change.
Delegate the noisy work, keep your context clean.
Most Claude Code sessions get slow and cluttered for the same reason: every exploratory grep, every log dump, and every “let me check one more file” stays in the main conversation forever.
When to move from Ollama to vLLM
Ollama is one of the easiest ways to run a local language model, but convenience can conceal the moment when a local experiment becomes a shared inference service that needs better scheduling and observability.
Stop AI agents drifting from specs, tests, and code.
AI coding agents ship features fast, but specs, tests, and code quietly drift apart. This guide covers a traceability model, spec-to-test and spec-to-code mapping, and the CI checks that catch drift before a merge.
Keep compiled knowledge trustworthy
An LLM Wiki fails when old facts remain plausible, contradictions become polished, and generated summaries drift from their sources.
AI GPU comparison across three vendors
The AI hardware landscape has shifted significantly in 2026, with NVIDIA, AMD, and Intel all competing for developers who need GPUs capable of running local large language models and AI inference workloads.
Protocol security is who may act, not the model.
Prompt injection gets most of the security attention in LLM systems, and it deserves attention, but it is not the whole problem once agents start calling tools and delegating work to other agents.
Long-running A2A tasks outlive chat sessions.
Most AI agent demos still behave like chat completions with extra steps: you send a prompt, wait a few seconds, and get an answer back in one response.
Faster LLM inference without quality loss - a practical guide
A 70B model generates one token per forward pass, and each pass reloads weights from VRAM, computes attention across the context, and synchronizes memory. Between tokens, the GPU sits idle while it waits for sequential dependencies to resolve.
The spec as source of truth, not a side document.
Spec-Driven Development is one of those ideas that software engineers have reached for before and then set aside when the effort stopped paying.