vLLM
8 pieces on vLLM, including 5 step-by-step guides.
Guides
Benchmark vLLM Speculative Decoding with EAGLE, n-gram, and MTP
Run vLLM's speculative decoding benchmark, configure EAGLE, EAGLE3, n-gram, custom draft models, and MTP, and interpret acceptance metrics.
Self-Hosting Your First LLM: Complete Hardware, Benchmark & Deployment Playbook
A complete engineering playbook for self-hosting production LLMs for AI agents: benchmark selection, quantization trade-offs, cloud GPU instance economics, and zero-switch proxy architecture.
Run LLMs Locally: 6 Practical Methods (Ollama, LM Studio, vLLM, Jan, llama.cpp, and llamafile)
Master 6 proven frameworks to host and run LLMs locally across Windows, macOS, and Linux with GPU acceleration, from one-click GUIs to high-throughput production servers.
Self-Host DeepSeek V4 with vLLM: 2026 Deployment Guide
Deploy DeepSeek V4 Flash or Pro with vLLM, size the GPU cluster, configure tensor parallelism, and compare self-hosting with current API prices.

Deploy an Open-Source LLM on Runpod Serverless with vLLM (2026)
Deploy a Hugging Face model as an OpenAI-compatible API on Runpod Serverless with the official vLLM worker: config, test calls, and fixes.
News & Analysis
2.4T-Parameter Qwen3.8 Runs on One Node With vLLM and NVFP4
AWS documents a single-node serving path for Qwen3.8-2.4T-A95B on a p6-b300 instance using NVFP4 quantization, cutting TTFT by nearly 60%.
DFlash Delivers 3.92x CPU Token Throughput on Qwen3.5-9B
DFlash in vLLM v0.25.0 hits 3.92x average token throughput on a Xeon 6975P-C CPU — a 74.40% cost cut with one config flag.
PagedAttention vs RadixAttention: How LLMs Tame the KV Cache
Two architectures attack LLM KV cache inefficiency from opposite angles — memory fragmentation and redundant prefill. Here is how each works.