Cohere Parse 5: 2.3B-Parameter VLM Beats Gemini 3 Flash on ParseBench

Cohere released Parse 5 (parse-v5.0) on August 27, 2026 — a 2.3-billion-parameter Vision Language Model purpose-built to convert visually complex enterprise documents into structured Markdown with bounding box coordinates for spatial grounding. For developers assembling RAG pipelines or document ingestion stacks currently stitching together rules-based OCR with fallback models, it offers a direct architectural alternative: a single API call returns both extracted text and the layout coordinates needed to trace every element back to its source position in the original PDF.

Architecture: Two-Stage Vision-Language Pipeline

Parse 5 is built on Cohere Labs' open-weight North-Micro-Vision-Instruct architecture, combining two independently sized components. The vision side is a custom-trained 400M-parameter native-resolution Vision Encoder initialised from SigLIP 2 SO400M, using 2D Rotary Positional Embeddings (RoPE) combined with learned 1D positional embeddings to preserve two-dimensional spatial layout — critical for correct reading-order reconstruction across multi-column layouts, tables, and mixed text-figure pages.

The language backbone is a 2B-parameter model (North Micro LLM) derived from Cohere's Command A+ architecture. The two components are joined through a "DeepStack" integration approach: patch embeddings from multiple layers of the vision encoder are injected into the early layers of the language model, giving it access to visual representations at multiple levels of abstraction rather than a single compressed page summary. A dedicated Projector module maps the vision encoder's feature space into the language model's embedding space.

The net output is structured Markdown plus per-element bounding box coordinates, bypassing the intermediate OCR layer that most document parsing stacks require. For regulated industries, those bounding boxes provide the coordinate-level audit trail that links every extracted data point to its pixel location in the source document.

Benchmark Position: ParseBench Results

Cohere evaluated Parse 5 on ParseBench, a rule-based benchmark comprising over 2,000 human-verified enterprise pages drawn from insurance, finance, and government document sets, testing table extraction, content faithfulness, and semantic formatting.

Parse 5's 79.2 places it roughly 11 points behind LlamaParse Agentic Plus but ahead of both Mistral OCR and Google Gemini 3 Flash (Thinking High), which each scored 75.05. For teams evaluating document parsing options — a space also tracked by work like the Chandra OCR 2 open-source benchmark — that gap against the leaderboard leader is the principal tradeoff to weigh against the model's size and deployment flexibility.

Availability and Integration

The API endpoint (POST https://api.cohere.com/v2/parse) accepts multipart form data with the document binary, model identifier, and output format. The Python client exposes response.text for Markdown content and response.bounding_boxes for layout elements. Beyond Cohere's own platform, parse-v5.0 is available through Microsoft Azure AI Foundry and Amazon SageMaker on AWS.

For teams not ready to commit to a managed API, Cohere has released the North-Micro-Vision-Instruct foundation model as open weights on Hugging Face, enabling local deployment and task-specific fine-tuning. The 2.4B-parameter scale is explicitly positioned as a fine-tuning base. A free Hugging Face Space provides UI-based testing before any API integration work begins.

Community discussion on r/RAG flagged two near-term friction points: the absence of OpenRouter availability and the lack of native PDF input, which currently requires page-by-page rendering before submission — a non-trivial overhead for high-volume batch ingestion pipelines. On r/LocalLLaMA, users reacted positively to the open-weight release while noting the compact scale is specifically intended for prototyping and fine-tuning rather than as a production ceiling.

The release reflects broader pressure in enterprise document parsing toward pipeline architecture rather than model scaling alone. Cohere's dual release strategy — managed API across three major platforms plus open weights for self-hosted fine-tuning — gives enterprise buyers an immediate integration path and a customisation option without requiring separate model procurement. Whether the roughly 11-point gap to LlamaParse Agentic Plus is material for a given team will depend on whether table extraction accuracy or deployment flexibility is the binding constraint in their stack.