7 builds of Home-FunctionGemma-270m, 7 signed runs on real machines: different packagers, precisions and engines, each a different file with its own numbers.
no context proved on this engine yet
35.9 tok/s peak, by mradermacher Q3_K_S
What it fits on
The smallest build needs about 0.3 GB; 18 of 18 kinds of machine on the network can hold it. Bars: each kind's memory (its card's, else RAM) · ticks: every build, at the size it held plus a fifth for the prompt.
How far back it remembers, machine by machine
Filled: the needle came back at that prompt size · outlined: asked and lost · blank: not asked · trained for 32K. 7 walks ended because the model forgot, 0 because the machine could not hold the prompt.
| machine · build | 4K | why it stopped |
|---|---|---|
| Gram ·acbe75Linux, CPU only · 4 CPUs · Q3_K_S by mradermacher | — the model lost the needle at 4K | |
| Gram ·acbe75Linux, CPU only · 4 CPUs · IQ4_XS by mradermacher | — the model lost the needle at 4K | |
| Gram ·acbe75Linux, CPU only · 4 CPUs · Q2_K by mradermacher | — the model lost the needle at 4K | |
| Gram ·acbe75Linux, CPU only · 4 CPUs · Q4_K_M by mradermacher | — the model lost the needle at 4K | |
| Gram ·acbe75Linux, CPU only · 4 CPUs · Q4_K_S by mradermacher | — the model lost the needle at 4K | |
| Gram ·acbe75Linux, CPU only · 4 CPUs · Q8_0 by mradermacher | — the model lost the needle at 4K | |
| Gram ·acbe75Linux, CPU only · 4 CPUs · F16 by mradermacher | — the model lost the needle at 4K |
Carbon per million tokens
Lowest build on each machine · 0 of 1 read off a power sensor, the rest modelled from the parts · fewer grams is better
Carbon is location-based: signed energy × the yearly average of the grid where the machine signed its place (world grid average (place not signed); Ember Global Electricity Review 2025 (2024 generation), location-based). Facility overhead is not included. A machine on its own solar is not credited until it can prove it.
Measured by
The people whose machines signed these numbers
Each its own file with its own page: the machines that ran it and their signatures.
| build | engine | whose work | memory | context proved | best tok/s | machines |
|---|---|---|---|---|---|---|
| Q3_K_S by mradermacherhf.co/mradermacher/Home-FunctionGemma-270m-GGUF:Q3_K_S | ollama | derivative · mradermacher | 0.3 GB | — | 35.9 | 1 |
| IQ4_XS by mradermacherhf.co/mradermacher/Home-FunctionGemma-270m-GGUF:IQ4_XS | ollama | derivative · mradermacher | 0.3 GB | — | 34.8 | 1 |
| Q2_K by mradermacherhf.co/mradermacher/Home-FunctionGemma-270m-GGUF:Q2_K | ollama | derivative · mradermacher | 0.3 GB | — | 34.5 | 1 |
| Q4_K_M by mradermacherhf.co/mradermacher/Home-FunctionGemma-270m-GGUF:Q4_K_M | ollama | derivative · mradermacher | 0.3 GB | — | 33.3 | 1 |
| Q4_K_S by mradermacherhf.co/mradermacher/Home-FunctionGemma-270m-GGUF:Q4_K_S | ollama | derivative · mradermacher | 0.3 GB | — | 32.8 | 1 |
| Q8_0 by mradermacherhf.co/mradermacher/Home-FunctionGemma-270m-GGUF:Q8_0 | ollama | derivative · mradermacher | 0.4 GB | — | 32.0 | 1 |
| F16 by mradermacherhf.co/mradermacher/Home-FunctionGemma-270m-GGUF:F16 | ollama | derivative · mradermacher | 0.6 GB | — | 22.5 | 1 |