LLM Infrastructure
7 pieces on LLM Infrastructure, including 1 step-by-step guide.
Guides
News & Analysis
Infrastructure Rewrites, Not Model Weights, Drive 2026 AI Gains
Four independent engineering efforts show runtime routing, service rewrites, and kernel fusion outperforming model compression on production AI systems.
NVIDIA's Switchyard Routes LLM Traffic Between OpenAI and Anthropic APIs
NVIDIA open-sources Switchyard, an Apache 2.0 Rust proxy that translates and routes LLM traffic across OpenAI and Anthropic wire formats, including streams.
NeMo Guardrails: Three Interception Points for Production LLM Safety
A developer tutorial builds FinBot on gpt-4o-mini with deterministic regex rails, LLM self-checks, retrieval filtering, and a six-probe coverage report.
Nvidia's AVO Harness Takes Claude Opus 5 from 30% to 100% on ARC-AGI-3
Nvidia's custom AVO harness lifted Claude Opus 5 from 30% to 100% on ARC-AGI-3 — without changing the model at all.
DeepSeek Harness v0.1: A Plugin-First MIT-Licensed Agent Framework
DeepSeek releases Harness v0.1 under MIT: a developer-preview agent framework where every capability — models, tools, UI — is a swappable Cordis plugin.
NOOA: NVIDIA's Object-Oriented Agent Framework Explained
NVIDIA open-sources NOOA, a Python framework that collapses prompt templates, tool schemas, and workflow graphs into one class—with 82.2% on SWE-bench Verified.