Ollama

13 pieces on Ollama, including 11 step-by-step guides.

Guides

Build a Self-Correcting RAG Agent with LangGraph and Milvus
guides
Shan2026-08-27
LangGraphRAGMilvusOllamaLangChain

Build a Self-Correcting RAG Agent with LangGraph and Milvus

Wire adaptive routing, corrective RAG, and self-RAG into a stateful LangGraph agent backed by Milvus Lite — no OpenAI key required.

Read more
guides
Shan2026-07-03
llmself-hostedollamahardwareprivacy

Self-Hosted LLM Guide 2026: Run AI Locally for Privacy & Savings

Complete 2026 guide to running LLMs locally for privacy and cost savings. Set up Ollama, llama.cpp, and vLLM on your hardware.

Read more
guides
Shan2026-06-07
Zero-Shot ClassificationLocal LLMOllamaNLPProduction AI

Build a Local LLM Zero-Shot Classifier You Can Actually Deploy

Learn how to run zero-shot text classification on a local model with Ollama, enforce strict JSON outputs, and add confidence-aware routing for production triage.

Read more
guides
architect2026-05-25T09:00:00Z
Local LLMsOllamallama.cppRAGDockerGGUFLLM Engineering

The Complete Developer Guide to Running LLMs Locally: From Ollama to Production

Everything you need to run LLMs on your own hardware in 2026: VRAM sizing, model formats, an 8-tool comparison table, a full local RAG pipeline, and Docker production deployment with GPU passthrough and Nginx auth.

Read more
guides
Shan2026-05-24
DeepSeekOllamaReasoning ModelsLocal LLMsRAG

How to Run DeepSeek R1 Locally with Ollama: Full Setup Guide

Install DeepSeek R1 locally using Ollama in under 5 minutes. Covers model variant selection from 1.5B to 671B, visible chain-of-thought reasoning, REST API usage, Python integration, and building a simple RAG application.

Read more
guides
Shan2026-05-24
Qwen3OllamaLocal LLMsPythonReasoning Models

How to Run Qwen3 Locally with Ollama: Setup, API, and a Gradio App

Set up Qwen3 locally in minutes using Ollama. Covers every model variant, thinking mode control with /think and /no_think tags, CLI, REST API, Python SDK, and a practical Gradio reasoning app.

Read more
guides
Shan2026-05-15
Claude CodeOllamaOpenRouterLiteLLMAI EngineeringLLM Infrastructure

The Developer's Guide to Running Claude Code for Free: Ollama, OpenRouter, and Local Proxies

Stop paying for Anthropic tokens. Learn the engineering patterns required to redirect Claude Code's CLI to local models via Ollama or high-parameter free models on OpenRouter.

Read more
Local RAG Tutorial: LangChain, Ollama & ChromaDB with Ragas
guides
Shan2026-05-13
Local RAGOllamaChromaDBLangChainRagas

Local RAG Tutorial: LangChain, Ollama & ChromaDB with Ragas

Build a fully local, private RAG system using Ollama, ChromaDB, and LangChain. Includes a Python Streamlit app, a Node.js variant, and automated evaluation with Ragas.

Read more
guides
Shan2026-04-29
Claude CodeOllamaLocal LLMsAgentsCode

Run Claude Code Locally with Ollama: A Complete Setup Guide

Learn how to set up a fully local AI coding agent by connecting Claude Code to Ollama and running open-source models like GLM 4.7 Flash — no cloud, no API costs, full privacy.

Read more
Guide
architect2026-04-25T10:00:00Z
AgentsLocal LLMsSLMsOllamaLangChain

Building AI Agents with Local Small Language Models (SLMs)

Learn how to build fully functional, private AI agents on your own hardware using Ollama and LangChain with lightweight models under 10B parameters.

Read more
Guide
architect2026-04-10T09:00:00Z
OllamaLocal LLMsPrivacyOpen SourceAI Engineering

How to Run Local LLMs Securely Using Ollama

A step-by-step tutorial on installing Ollama, pulling models like Llama 3, and running private queries without data leaks.

Read more

News & Analysis