4 builds of 12b~yuxinlu1, 4 signed runs on real machines: different packagers, precisions and engines, each a different file with its own numbers.
trained 256K · proved 128K context, by yuxinlu1 Q4_K_M
25.8 tok/s peak, by yuxinlu1 Q4_K_M
What it fits on
The smallest build needs about 7.6 GB; 13 of 18 kinds of machine on the network can hold it. Bars: each kind's memory (its card's, else RAM) · ticks: every build, at the size it held plus a fifth for the prompt.
How far back it remembers, machine by machine
Filled: the needle came back at that prompt size · outlined: asked and lost · blank: not asked · trained for 256K. 1 walk ended because the model forgot, 0 because the machine could not hold the prompt.
| machine · build | 4K | 8K | 16K | 32K | 64K | 128K | why it stopped |
|---|---|---|---|---|---|---|---|
| Gram ·a5be462× Tesla T4 · Q6_K by yuxinlu1 | 128K recalled at every size asked | ||||||
| Gram ·a5be462× Tesla T4 · Q8_0 by yuxinlu1 | 128K recalled at every size asked | ||||||
| Gram ·a5be462× Tesla T4 · Q3_K_M by yuxinlu1 | 128K recalled at every size asked | ||||||
| Gram ·a5be462× Tesla T4 · Q4_K_M by yuxinlu1 | 4K the model lost the needle at 8K |
Measured by
The people whose machines signed these numbers
proved by at least one build: Tool calling · Tool loop finished · Faithful to tool results · Chained tool calls · Structured output · Sustained output · Extended thinking · Writes code · Reasons about code · Synthesises sources · Follows instructions
Each its own file with its own page: the machines that ran it and their signatures.
| build | engine | whose work | memory | context proved | best tok/s | machines |
|---|---|---|---|---|---|---|
| Q4_K_M by yuxinlu1hf.co/yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF:Q4_K_M | ollama | yuxinlu1 | 8.9 GB | 128K | 25.8 | 1 |
| Q6_K by yuxinlu1hf.co/yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF:Q6_K | ollama | yuxinlu1 | 18.7 GB | 128K | 20.0 | 1 |
| Q8_0 by yuxinlu1hf.co/yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF:Q8_0 | ollama | yuxinlu1 | 18.2 GB | 128K | 18.0 | 1 |
| Q3_K_M by yuxinlu1hf.co/yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF:Q3_K_M | ollama | yuxinlu1 | 7.6 GB | 128K | 17.0 | 1 |