LoRA
5 pieces on LoRA, including 1 step-by-step guide.
Guides
News & Analysis
SigLIP LoRA Fine-Tune Cuts Under-Labeling from 9.4% to 3.4%
Alma Media's 23-class image classifier shows why under-labeling rate, not F1, is the right signal for deciding whether LoRA fine-tuning is worth the cost.
Read more →
Qwen2.5-0.5B Fine-Tuned With DPO After Auditing HH-RLHF Length Bias
A reproducible pipeline audits Anthropic HH-RLHF for lexical shortcuts, then fine-tunes Qwen2.5-0.5B-Instruct with DPO, TRL, and LoRA in one notebook.
Read more →
Fine-Tuning Qwen3-0.6B for Tool Calling with XYZ-Aquila-SFT
A reproducible SFT pipeline streams 400 XYZ-Aquila-SFT trajectories, bypasses apply_chat_template to preserve reasoning blocks, and fine-tunes Qwen3-0.6B with LoRA.
Read more →
IMDb Sentiment Analysis: DistilBERT LoRA vs TF-IDF with Calibration and Semi-Supervised Learning
A reproducible pipeline pitting TF-IDF + Logistic Regression against DistilBERT LoRA on IMDb, with calibration, occlusion saliency, and pseudo-labelling.
Read more →