45 tokens a second on Linux · 2× Tesla T4 15 GB · 4 CPUs · 31 GB RAM. About $5.62 per million tokens here, against OpenRouter's $0.40: the API is 14× cheaper. Run it here for privacy or to keep work on your own machines, not to save money.
1 build of GLM-4.7 FLASH, 14 signed runs on real machines: different packagers, precisions and engines, each a different file with its own numbers.
trained 198K · proved 128K context, by unsloth Q4_K_M
213.3 tok/s peak, by unsloth Q4_K_M
Speed against price, every machine
Up and left is faster and cheaper · the line joins machines no other beats on both · price on a log scale · dashed: OpenRouter
Same build, different machines
Q4_K_M by unsloth on 14 machines: the fastest decodes 169× as fast as the slowest. One dot per machine, tokens per second.
What it fits on
The smallest build needs about 31.1 GB; 2 of 18 kinds of machine on the network can hold it. Bars: each kind's memory (its card's, else RAM) · ticks: every build, at the size it held plus a fifth for the prompt.
How far back it remembers, machine by machine
Filled: the needle came back at that prompt size · outlined: asked and lost · blank: not asked · trained for 198K. 0 walks ended because the model forgot, 5 because the machine could not hold the prompt.
| machine · build | 4K | 8K | 16K | 32K | 64K | 128K | why it stopped |
|---|---|---|---|---|---|---|---|
| Gram ·a5be462× Tesla T4 · Q4_K_M by unsloth | 128K too slow to answer here | ||||||
| Gram ·dae679NVIDIA L4 · Q4_K_M by unsloth | 128K too slow to answer here | ||||||
| Gram ·662a4eLinux, CPU only · 4 CPUs · Q4_K_M by unsloth | 4K too slow to answer here | ||||||
| Gram ·e61d3b2× Tesla T4 · Q4_K_M by unsloth | 4K too slow to answer here | ||||||
| Gram ·e3654fLinux, CPU only · 4 CPUs · Q4_K_M by unsloth | 4K too slow to answer here |
Carbon per million tokens
Lowest build on each machine · 2 of 5 read off a power sensor, the rest modelled from the parts · fewer grams is better
Carbon is location-based: signed energy × the yearly average of the grid where the machine signed its place (world grid average (Singapore not in the table) · United States grid average · EU grid average (applied to NL) · world grid average (Australia not in the table); Ember Global Electricity Review 2025 (2024 generation), location-based). Facility overhead is not included. A machine on its own solar is not credited until it can prove it.
Measured by
The people whose machines signed these numbers
and 4 more
proved by at least one build: Tool calling · Tool loop finished · Faithful to tool results · Chained tool calls · Structured output · Sustained output · Extended thinking · Writes code · Reasons about code · Synthesises sources · Follows instructions
Each its own file with its own page: the machines that ran it and their signatures.
| build | engine | whose work | memory | context proved | best tok/s | machines |
|---|---|---|---|---|---|---|
| Q4_K_M by unslothhf.co/unsloth/GLM-4.7-Flash-GGUF:Q4_K_M | ollama | quantizer · unsloth | 31.1 GB | 128K | 213.3 | 14 |
Fine-tunes, merges and abliterations of this member, each its own model with its own page. None of their numbers are counted above.