llama.cpp
5 pieces on llama.cpp, including 4 step-by-step guides.
Guides
Fine-Tuning LLMs with LoRA: A Complete Practical Guide to Training & GGUF Deployment
Master end-to-end LoRA fine-tuning for SLMs: synthetic data generation, benchmarking against 7B baselines, lit-gpt training, and GGUF serving with llama.cpp.
Read more →
Guaranteed JSON from llama.cpp with Pydantic and GBNF grammars
Use llama.cpp's GBNF grammar constraints and Pydantic validation together to make invalid JSON structurally impossible at inference time.
Read more →
The Complete Developer Guide to Running LLMs Locally: From Ollama to Production
Everything you need to run LLMs on your own hardware in 2026: VRAM sizing, model formats, an 8-tool comparison table, a full local RAG pipeline, and Docker production deployment with GPU passthrough and Nginx auth.
Read more →
Run DeepSeek V4 Flash Locally with llama.cpp (2026)
Run DeepSeek V4 Flash locally with llama.cpp, a GGUF build, one 96GB GPU, and explicit checks for the current experimental support path.
Read more →