12 tokens a second on Linux · NVIDIA 15 GB · 4 CPUs · 31 GB RAM. No hosted API sells it, so this network is the place to run it.
1 build of Qwen 3 VL-4B, 1 signed run on real machines: different packagers, precisions and engines, each a different file with its own numbers.
What it fits on
The smallest build needs about 33.9 GB; 1 of 18 kinds of machine on the network can hold it. Bars: each kind's memory (its card's, else RAM) · ticks: every build, at the size it held plus a fifth for the prompt.
How far back it remembers, machine by machine
Filled: the needle came back at that prompt size · outlined: asked and lost · blank: not asked · trained for 256K. 0 walks ended because the model forgot, 0 because the machine could not hold the prompt.
| machine · build | 4K | 8K | 16K | 32K | 64K | 128K | why it stopped |
|---|---|---|---|---|---|---|---|
| Gram ·a5be462× Tesla T4 · F16 by Qwen | 128K recalled at every size asked |
Measured by
The people whose machines signed these numbers
proved by at least one build: Tool calling · Faithful to tool results · Structured output · Sustained output · Vision · Counts in images · Multiple images at once · Spatial reasoning · Writes code · Follows instructions
Each its own file with its own page: the machines that ran it and their signatures.
| build | engine | whose work | memory | context proved | best tok/s | machines |
|---|---|---|---|---|---|---|
| F16 by Qwenhf.co/Qwen/Qwen3-VL-4B-Instruct-GGUF:F16 | ollama | vendor · Qwen | 33.9 GB | 128K | 12.2 | 1 |