vLLM

8 pieces on vLLM, including 5 step-by-step guides.

Guides

guides
architect • 2026-10-26
vLLMspeculative decodingEAGLEn-gramMTPGPU inference

Benchmark vLLM Speculative Decoding with EAGLE, n-gram, and MTP

Run vLLM's speculative decoding benchmark, configure EAGLE, EAGLE3, n-gram, custom draft models, and MTP, and interpret acceptance metrics.

Read more →
guides
Shan • 2026-10-11
self-hostinglocal-llmvllmgpu-cloudquantizationlitellm

Self-Hosting Your First LLM: Complete Hardware, Benchmark & Deployment Playbook

A complete engineering playbook for self-hosting production LLMs for AI agents: benchmark selection, quantization trade-offs, cloud GPU instance economics, and zero-switch proxy architecture.

Read more →
guides
Shan • 2026-10-03
local-llmollamavllmllama-cpplm-studiojan-aillamafile

Run LLMs Locally: 6 Practical Methods (Ollama, LM Studio, vLLM, Jan, llama.cpp, and llamafile)

Master 6 proven frameworks to host and run LLMs locally across Windows, macOS, and Linux with GPU acceleration, from one-click GUIs to high-throughput production servers.

Read more →
guides
Shan • 2026-05-24
DeepSeekvLLMGPU InfrastructureSelf-HostingLocal LLMs

Self-Host DeepSeek V4 with vLLM: 2026 Deployment Guide

Deploy DeepSeek V4 Flash or Pro with vLLM, size the GPU cluster, configure tensor parallelism, and compare self-hosting with current API prices.

Read more →
Deploy an Open-Source LLM on Runpod Serverless with vLLM (2026)
guides
Shan • 2026-04-10
RunpodvLLMServerlessDeploymentOpenAI APIGPU Cloud

Deploy an Open-Source LLM on Runpod Serverless with vLLM (2026)

Deploy a Hugging Face model as an OpenAI-compatible API on Runpod Serverless with the official vLLM worker: config, test calls, and fixes.

Read more →

News & Analysis