Production AI

13 pieces on Production AI, including 1 step-by-step guide.

Guides

News & Analysis

We Planted 20 Wrong Figures for 4 LLM Editors. Here's What Survived
articles
Shan • 2026-10-11
LLM EvaluationFact-CheckingDeepSeekGeminiClaudeProduction AI

We Planted 20 Wrong Figures for 4 LLM Editors. Here's What Survived

We replayed real edit prompts against Sonnet 4.6, DeepSeek V4 Pro, GPT-5.6 Sol and Gemini 3.1 Pro. Self-reported confidence told us nothing.

Read more →
AI’s New Deployment Layer: Interfaces, Not Generated Text
articles
Shan • 2026-10-10
production-aiai-infrastructureopenaigoogle-geminireka-rho-1ai-agents

AI’s New Deployment Layer: Interfaces, Not Generated Text

OpenAI, Google, and Reka are competing for schemas, identity, and actuation—not chat quality. Machine-consumable actions now define AI deployment.

Read more →
news
Shan • 2026-10-09
OpenAITyped OutputsAPI PricingModel ReleaseProduction AI

OpenAI Decisions API Beta: 10x Faster Typed Answers, $0.10 Input

OpenAI's gpt-6-luna Decisions endpoint returns probabilities, choices and scores at $0.10 per million input tokens, with no output fees and a vendor-stated 10x speedup.

Read more →
news
Shan • 2026-10-02
Search InfrastructureLatency OptimizationPipeline ArchitectureUberProduction AI

Uber Eats Cuts Search Latency 50% With Pipeline Rewrites, Not New Models

Uber reports a 50% cut in Uber Eats search latency by redesigning retrieval, hydration, ranking, and ad-serving — no model changes required.

Read more →
Constrained Inference Beats Generation on Speed, Cost, and Predictability
articles
Shan • 2026-09-23
inference architecturestructured extractionLLM opsproduction AIefficiency

Constrained Inference Beats Generation on Speed, Cost, and Predictability

Three September 2026 releases show that replacing open-ended token generation with deterministic or classification-style inference produces faster, cheaper, more reliable AI systems.

Read more →
Infrastructure Rewrites, Not Model Weights, Drive 2026 AI Gains
articles
Shan • 2026-09-16
inference optimizationsystems engineeringLLM infrastructureproduction AINVIDIAOpenAI

Infrastructure Rewrites, Not Model Weights, Drive 2026 AI Gains

Four independent engineering efforts show runtime routing, service rewrites, and kernel fusion outperforming model compression on production AI systems.

Read more →
Production AI Fails on Architecture, Not Model Intelligence
articles
Shan • 2026-09-09
AI AgentsSystems ArchitectureRAGMulti-Agent SystemsProduction AI

Production AI Fails on Architecture, Not Model Intelligence

Enterprise AI deployments stall because the harness breaks, not the model. Three failure modes prove why domain-specific architecture beats scaling.

Read more →
news
Shan • 2026-09-02
Context EngineeringLLM ArchitectureRedisLangChain4jProduction AI

Five Context Failure Modes That a Model Upgrade Cannot Fix

Redis advocate Ricardo Ferreira catalogues five production context failures and the pipeline architecture—not model swaps—that resolves them.

Read more →
news
Shan • 2026-08-31
Agentic AIMLOpsObservabilityLLMProduction AI

Five MLOps Assumptions That Silently Pass Failed Agent Runs

MLOps monitoring reports healthy on runs that failed. Here are the five structural assumptions that break when a model starts calling tools.

Read more →
Pipeline Architecture, Not Better Models, Drives 2026's Biggest AI Gains
articles
Shan • 2026-08-22
multi-agent systemsAI pipelinesproduction AIorchestrationcost optimisation

Pipeline Architecture, Not Better Models, Drives 2026's Biggest AI Gains

Four independent deployments—AWS, Cloudflare, Fanatics, and async Bedrock—achieved step-change results by decomposing monolithic agents, not upgrading models.

Read more →
news
Shan • 2026-08-20
LLM EvaluationAgentic WorkflowsLLMOpsPrompt EngineeringProduction AI

LLM Judge Approved Its Own Errors: Three Biases Explained

A production SQL pipeline approved wrong queries for weeks. The judge and generator shared the same model — and that structural flaw caused the incident.

Read more →
Articles
Shan • 2026-06-10
Prompt EngineeringDSPyLLM EvaluationProduction AILLMOps

Stop Hand-Tuning Prompts: A Production Workflow for Automated LLM Optimization

Move beyond trial-and-error prompting with a measurable workflow for evaluating and optimizing LLM prompts in production systems.

Read more →