Gemma 4 12B
Gemma 4 12B · Q8_0 · by unsloth
hf.co/unsloth/gemma-4-12b-it-GGUF:Q8_0
unsloth · Q8_0 · on ollama · quantizer build
Measured by one node on hardware we do not own, and signed by each of them. What machines here actually proved — never what the card claims.
matrix built 12 Nov 2026 · every field verified against the signature of the node that produced it, and re-verifiable by you: each signed figure carries the exact bytes the node signed (signing_payload_b64) and the signature over them, and the ed25519 public key is embedded in node_did. effective_ctx is the context length a node PROVED by recall, never the length a model card advertisesRun it on your gram Install a gram with one command. It measures models like this one on your own machine and signs every result.Use it in your own room Ask Evo in your gramx and it runs on a machine that proved it. On your own machines it costs you nothing.
context declared256Kwhat the runtime reported. A node attests it was told this; nobody attests it is true.
context proved by recall256Kthe largest size at which a machine could still find tokens planted across the whole prompt — start, middle and end, all of which had to come back.
A machine here made it use everything the runtime declared.
Languages, proved
Each question was put entirely in its own language and script, and the answer had to be right. A model with no coverage cannot parse the question, so answering in English is a failure here, not a pass. 14 proved of 15 asked — a language absent from the probe set was never asked, and is not a claim either way.
Capabilities, measured
Speech outprobed, and failed
The model itself turned text into audio — identified from the container bytes, not from what the engine labelled them, so an error page announced as audio cannot pass. Distinct from this gram running a separate text-to-speech engine: an operator choosing between them is choosing between two architectures.Reasons about codepassed
Asked to predict exactly what a short program prints. This is the half of coding that matters for agent work and that writing valid syntax does not demonstrate: following state through control flow.Writes codepassed
Asked for a specific function and checked with the Go compiler’s own parser. Nothing is executed — running model-written code to score a model would be a security hole opened for a metric — but syntactic validity is a fact rather than an opinion.Embeddingsprobed, and failed
The engine was asked for an embedding of a short text and returned a real, non-zero vector.Follows instructionspassed
Given a plain constraint on its output format and checked for exact obedience. This separates an instruct-tuned model from a base one — a base model answers fluently and ignores every instruction, which then looks like a dozen unrelated weaknesses instead of one.Sustained outputpassed
Asked to produce a long structured answer and checked for length. A model that stops after a couple of hundred tokens cannot write a report, however capable it is otherwise.Structured outputpassed
The ENGINE was asked to constrain decoding to a schema, and the answer conformed. This is stronger than politely asking for JSON and hoping: the grammar makes invalid output unreachable, which is what an operator actually builds on.Extended thinkingpassed
The model emitted reasoning on the engine’s dedicated reasoning channel before answering. Read from that channel rather than by scanning the answer for tags, which is why models that reason are no longer reported as models that do not.Synthesises sourcespassed
Given three documents with one fact split across them, and required to combine rather than quote. No single document contains the answer, so a model that retrieves without reasoning cannot pass.Tool callingpassed
The node asked the model to call a function and checked that it called the RIGHT one with a well-formed argument — not merely that it emitted a tool name.Faithful to tool resultspassed
The model was handed a list through a tool and had to report every item back. Calling a tool and understanding its answer are different abilities: a model can produce a perfect call, receive nine items, and confidently report three. This is the flag that separates them.Tool loop finishedpassed
Whether the conversation ENDED after the tool call, or the model kept calling until the turn budget ran out. A model that passes tool calling and fails this will call a tool in production and never come back.Chained tool callspassed
The model had to call one tool, read its answer, and call a second with a value derived from it. One call is not agentic work — real specialist jobs are sequences, and a model that never takes the second step looks, from outside, exactly like a specialist silently doing nothing.Counts in imagespassed
Shown a row of shapes and asked how many. Reading rendered text and grasping a scene are different abilities, and a model can do the first with no spatial understanding at all — which is what charts, shelf photographs and document layout actually need.Multiple images at oncepassed
Given two images and asked to compare them. Many engines and models accept one image per turn and silently drop the rest, which turns a comparison into a confident answer about half the evidence.Visionpassed
A four-digit code was rendered into an image and the model had to read it back. A model that cannot see cannot guess four digits, and a model that can has no reason to fail — so this passes and fails for the right reason, which describing a picture never did.Spatial reasoningpassed
Asked which of two shapes is larger and on which side — both ways round, so a coin flip cannot pass. Reading glyphs, counting objects and understanding layout are three different abilities, and only the third answers "what is next to what", which is what charts, diagrams and shelf photographs turn on.Audioprobed, and failed
Given audio and asked to transcribe it.Other builds of Gemma 4 12B
every other build of this member measured on the network — compare what each actually provedhf.co/unsloth/gemma-4-12b-it-GGUF:Q4_K_Munsloth · Q4_K_M · ollama
128K ctx proved2 nodes
hf.co/google/gemma-4-12B-it-qat-q4_0-gguf:Q4_0google · Q4_0 · ollama
128K ctx proved1 node
hf.co/unsloth/gemma-4-12b-it-GGUF:IQ4_XSunsloth · IQ4_XS · ollama
128K ctx proved1 node
hf.co/unsloth/gemma-4-12b-it-GGUF:BF16unsloth · BF16 · ollama
128K ctx proved1 node
signed by this networkEvery line traces to a node signature.
What machines here proved
context proved by recall256K
peak throughput ever signed18.55 tok/s · did:epn:002408…a5be46
resident while loaded14.7 GiB (14.7 on card) · did:epn:002408…a5be46
machines that measured it1
regions it was proved in1
from the public record · unsignedollama /api/show; the node attests that the runtime reported these, not that they are true. Attested by did:epn:002408…a5be46.The only unsigned block on this page. We attest we read these from the runtime — not that they are true. Nobody signs a model card.
What the runtime says about it
context declared256K
parameters11.9B
parameter count11,90,73,50,576
quantisationQ8_0
familygemma4
formatgguf
Proven across regions
Measured by
ranked on the provider standingsThe machine that measured it
nothing is averaged — the machine is what you are choosingdid:epn:002408…a5be46Washington · 20511 · 0.40.10 · on host · 24 Oct 2026
256Kctx provedrecalled at every size asked
—tok/s now14.7 GiB resident · 14.7 GiB on card · 12.0 GiB on disk
✗ Speech out✓ Reasons about code✓ Writes code✗ Embeddings✓ Follows instructions✓ Structured output✓ Extended thinking✓ Tool calling✓ Faithful to tool results✓ Tool loop finished✓ Counts in images✓ Multiple images at once✓ Vision✓ Spatial reasoning✗ Audio✓ 11 languages
How far back it remembers, machine by machine
Filled: the needle came back at that prompt size · outlined: asked and lost · blank: not asked · trained for 256K. 0 walks ended because the model forgot, 0 because the machine could not hold the prompt.
| machine · build | 4K | 8K | 16K | 32K | 64K | 128K | 256K | why it stopped |
|---|---|---|---|---|---|---|---|---|
| Gram ·a5be462× Tesla T4 · Q8_0 by unsloth | 256K recalled at every size asked |
Run this where your data already is
Tell us the workload, whose machines it should run on, and which jurisdiction it answers to.