AI Infrastructure
25 pieces on AI Infrastructure, including 1 step-by-step guide.
Guides
News & Analysis
AI’s New Deployment Layer: Interfaces, Not Generated Text
OpenAI, Google, and Reka are competing for schemas, identity, and actuation—not chat quality. Machine-consumable actions now define AI deployment.
Unikraft Fits 1,024,132 Firecracker VMs on One 48-Core Server
Unikraft's unikernel microVMs cold-resume in ~10 ms from snapshots, enabling over 1 million scale-to-zero sandboxes on a single server.
HydraFusion Cuts Costs 67% While Beating Opus 5 on TerminalBench
GitHub's Project HydraFusion builds a per-request execution plan in Copilot CLI, routing across models from multiple providers to cut costs up to 67%.
Three Tools, One Stack: Local AI Infrastructure Is Now Engineered
Three releases in 48 hours — PAIR, Lily, and zg — form an interoperable client-side inference stack that bypasses cloud latency, cost, and data-exposure constraints.
Shopify's Gisting Cuts 6,000-Token Prompts to 1,500, Drops Latency 38%
Shopify compressed Sidekick's system prompt from 6,000 to 1,500 tokens using learned gist embeddings, cutting end-to-end latency from 6.8s to 4.2s in production.
Nvidia's Vera Rubin Delivers 3x Storage Gains Beyond the GPU
Nvidia's Vera Rubin stack delivers up to 3x storage operation gains via the Vera CPU — shifting its moat from GPU silicon to data orchestration.
EPA Moves to Kill Public Notice Rules for Data Center Air Permits
The EPA proposes eliminating federal public participation requirements for minor-source air permits, letting states decide whether data center neighbors get any say.
Architectural Specificity Now Outperforms GPU Scaling Alone
Three independent data points from one week show that workload-specific architecture delivers gains raw GPU procurement cannot match at any price.
MTIA 300 Cuts Recommendation Model Comms Time 3.9x vs GPU
Meta's MTIA 300 puts 12 × 800 Gbps RDMA NICs on-package, hitting 940 GB/s intra-rack bandwidth and 3.9× lower communication time on a 150B-parameter model.
UK Grid Queue Hit 125 GW as Phantom Data Centers Pile In
Speculative data center applications drove UK grid queue demand from 41 GW to 125 GW in seven months. Ofgem's fix could lock out smaller AI operators.
Anthropic Signs $45B Nscale Deal for Vera Rubin Compute by 2027
Anthropic's $45B, six-year Nscale deal adds Vera Rubin capacity from a West Virginia data center, extending a compute spree that now spans six partners.
MetaRoCE Holds 86% Throughput at 1% Loss Where RoCEv2 Collapses
Meta's MetaRoCE drops PFC entirely, sprays packets across paths, and sustains ~86% throughput at 1% loss on a 64-node AMD GPU cluster.
Nvidia Takes Minority Stake in Data Center Site Developer Cloverleaf
Nvidia acquires a minority equity stake in Cloverleaf Infrastructure, a 2024-founded power-site middleman, in a deal likely worth several hundred million dollars.
LinkedIn's Multi-Agent Code Review Hits 63.9% Acceptance Across 1,727 PRs
LinkedIn's production multi-agent code review platform achieved 63.9% overall acceptance across 5,230 comments from 1,727 PRs, with 100% on concurrency bugs.
DeepSeek Harness Ships Micro-Kernel Agent Runtime Under MIT License
DeepSeek's open-source dsh runtime loads every agent component—model adapters, tools, sandboxes—as swappable plugins on the Cordis meta-framework.
Relativity Networks Raises $22M to Cut Data Center Fiber Latency 30%
Hollow-core fiber transmits signals 30% faster than glass-core fiber. A $40M hyperscaler order suggests the physics finally matter at AI cluster scale.
Nvidia Invests $1.5B in SB Energy, Locks In Sole GPU Supply at Ports-Pike
Nvidia's $1.5B equity stake in SB Energy makes it the sole compute supplier at the OpenAI-linked Ports-Pike data center, backed by up to $105B in credit.
Stripe Acquires AI Gateway OpenRouter for $7B+
Stripe has finalized a deal to acquire OpenRouter at $7B+, a 5x-plus jump from the startup's $1.3B Series B valuation set just months ago.
Noreva Warns Natural Gas Could Top $10/MMBtu at Some U.S. Hubs
Energy research firm Noreva forecasts natural gas prices above $10/MMBtu at some U.S. hubs, threatening the cost model behind hyperscalers' gigawatt-scale gas bets.
Software Extraction Beats Hardware Acquisition at the AI Frontier
GLM-5.3, Kog, and Needle 2 show that post-training, bandwidth recovery, and compression outperform new compute spend in August 2026.
Databricks Raises $5B at $190B Valuation After $15B Investor Demand
Databricks targeted $1B, faced $15B in investor demand, and settled on $5B at a $190B valuation — backed by $7B ARR growing 80% YoY.
General Catalyst Leads $1.1B Round into 2-Month-Old River AI
River AI, founded by xAI co-founder Igor Babuschkin, raises $1.1B to rebuild the AI stack and make agents personally trainable.
Subquadratic Says SubQ Breaks the LLM Attention Bottleneck
Subquadratic claims its sparse-attention SubQ model can process far longer context at much lower cost, but real-world access remains limited.
Nvidia Tightens Grip on AI Market with $95 Billion Supply Chain Bet
Nvidia is aggressively locking down the AI chip supply chain, committing nearly $100 billion to vendors to ensure hardware dominance and meet explosive demand.