family member
FunctionGemma logo

FunctionGemma 270M

341 tokens a second on Linux · L4 23 GB · 12 CPUs · 53 GB RAM. No hosted API sells it, so this network is the place to run it.

7 builds of FunctionGemma 270M, 9 signed runs on real machines: different packagers, precisions and engines, each a different file with its own numbers.

341tok/s, fastest machine
$0.63per M tokens · no API sells it
0.2 GBmemory, smallest build
3providers measured it
best on ollama · 7 builds

no context proved on this engine yet

340.8 tok/s peak, by unsloth Q4_K_M

Speed against price, every machine

Up and left is faster and cheaper · the line joins machines no other beats on both · price on a log scale

$1USD per million tokenstok/sLinux · L4 23 GB · 12 CPUs · 53 GB RAM · 4-bit by unsloth · 340.82 tok/s · $0.6334/MLinux · no GPU · 4 CPUs · 31 GB RAM · 4-bit by Mungert · 40.24 tok/s · $0.7588/MLinux · no GPU · 4 CPUs · 31 GB RAM · 4-bit by unsloth · 37.25 tok/s · $0.8216/MLinux · no GPU · 4 CPUs · 31 GB RAM · 4-bit by victor · 36.7 tok/s · $0.834/MLinux · no GPU · 4 CPUs · 31 GB RAM · 3-bit by Mungert · 34.43 tok/s · $0.8878/MLinux · no GPU · 4 CPUs · 31 GB RAM · 4-bit by unsloth · 33.83 tok/s · $0.9049/MLinux · no GPU · 4 CPUs · 31 GB RAM · 4-bit by Mungert · 33.51 tok/s · $0.912/MLinux · no GPU · 4 CPUs · 31 GB RAM · 8-bit by unsloth · 32.9 tok/s · $0.9315/MLinux · no GPU · 4 CPUs · 31 GB RAM · 4-bit by Mungert · 32.75 tok/s · $0.9347/MLinux · no GPU · 4 CPUs · 31 GB RAM · 3-bit by unsloth · 32.63 tok/s · $0.9367/MLinux · no GPU · 4 CPUs · 31 GB RAM · 2-bit by unsloth · 32.5 tok/s · $0.9401/MWindows · Intel(R) Iris(R) Xe Graphics 1 GB · 8 CPUs · 16 GB RAM · 4-bit by unsloth · 23.66 tok/s · $3.0082/MLinux · no GPU · 4 CPUs · 31 GB RAM · 8-bit by Mungert · 22.34 tok/s · $1.3783/MLinux · no GPU · 4 CPUs · 31 GB RAM · 16-bit (full precision) by Mungert · 20.08 tok/s · $1.5355/MLinux · no GPU · 4 CPUs · 31 GB RAM · 16-bit (full precision) by unsloth · 18.71 tok/s · $1.6483/M

Same build, different machines

Q4_K_M by unsloth on 3 machines: the fastest decodes 14× as fast as the slowest. One dot per machine, tokens per second.

  1. NVIDIA L4×1341 tok/s
  2. Linux, CPU only · 4 CPUs×134 tok/s
  3. Intel(R) Iris(R) Xe Graphics×124 tok/s

What it fits on

The smallest build needs about 0.2 GB; 18 of 18 kinds of machine on the network can hold it. Bars: each kind's memory (its card's, else RAM) · ticks: every build, at the size it held plus a fifth for the prompt.

  1. Linux, CPU only · 2 CPUs1 GB RAMevery build
  2. NVIDIA GeForce RTX 3050 Laptop GPU4 GB on the cardevery build
  3. NVIDIA GeForce GTX 16504 GB on the cardevery build
  4. AMD Radeon(TM) Vega 8 Mobile Graphics7 GB RAMevery build
  5. Windows, CPU only · 12 CPUs7 GB RAMevery build
  6. Apple silicon8 GB RAMevery build
  7. Apple M18 GB RAMevery build
  8. Mac, CPU only · 8 CPUs8 GB RAMevery build
  9. NVIDIA GeForce RTX 3080 Ti12 GB on the cardevery build
  10. Tesla T415 GB on the cardevery build
  11. Intel(R) UHD Graphics 73016 GB RAMevery build
  12. Intel(R) Iris(R) Xe Graphics16 GB RAMevery build
  13. Apple M416 GB RAMevery build
  14. Apple M116 GB RAMevery build
  15. NVIDIA L422 GB on the cardevery build
  16. 2× Tesla T429 GB on the cardevery build
  17. Linux, CPU only · 4 CPUs31 GB RAMevery build
  18. NVIDIA RTX PRO 6000 Blackwell Server Edition95 GB on the cardevery build

How far back it remembers, machine by machine

Filled: the needle came back at that prompt size · outlined: asked and lost · blank: not asked · trained for 32K. 8 walks ended because the model forgot, 0 because the machine could not hold the prompt.

machine · build4K8K16Kwhy it stopped
Gram ·dae679NVIDIA L4 · Q4_K_M by unsloth— the model lost the needle at 4K
Gram ·acbe75Linux, CPU only · 4 CPUs · Q4_0 by unsloth— the model lost the needle at 4K
Gram ·acbe75Linux, CPU only · 4 CPUs · Q4_K_M by unsloth— the model lost the needle at 4K
Gram ·acbe75Linux, CPU only · 4 CPUs · Q8_0 by unsloth— the model lost the needle at 4K
Gram ·acbe75Linux, CPU only · 4 CPUs · IQ3_XXS by unsloth— the model lost the needle at 4K
Gram ·acbe75Linux, CPU only · 4 CPUs · IQ2_M by unsloth— the model lost the needle at 4K
Gram ·2e5c02Intel(R) Iris(R) Xe Graphics · Q4_K_M by unsloth— the model lost the needle at 4K
Gram ·acbe75Linux, CPU only · 4 CPUs · BF16 by unsloth— the model lost the needle at 4K

Carbon per million tokens

Lowest build on each machine · 1 of 3 read off a power sensor, the rest modelled from the parts · fewer grams is better

  1. Gram ·acbe75146 g1.11 J/tok · modelled
  2. Gram ·dae679887 g6.75 J/tok · sensor
  3. Gram ·2e5c021.9 kg9.87 J/tok · modelled

Carbon is location-based: signed energy × the yearly average of the grid where the machine signed its place (world grid average (place not signed) · world grid average (Singapore not in the table) · India grid average; Ember Global Electricity Review 2025 (2024 generation), location-based). Facility overhead is not included. A machine on its own solar is not credited until it can prove it.

Measured by

The people whose machines signed these numbers

proved by at least one build: Structured output · Sustained output · Writes code · Reasons about code

Every build

Each its own file with its own page: the machines that ran it and their signatures.

buildenginewhose workmemorycontext provedbest tok/smachines
Q4_K_M by unslothhf.co/unsloth/functiongemma-270m-it-GGUF:Q4_K_Mollamaquantizer · unsloth0.4 GB—340.83
Q4_0 by unslothhf.co/unsloth/functiongemma-270m-it-GGUF:Q4_0ollamaquantizer · unsloth0.3 GB—37.21
IQ2_XXS by unslothhf.co/unsloth/functiongemma-270m-it-GGUF:IQ2_XXSollamaquantizer · unsloth0.2 GB—33.11
Q8_0 by unslothhf.co/unsloth/functiongemma-270m-it-GGUF:Q8_0ollamaquantizer · unsloth0.4 GB—32.91
IQ3_XXS by unslothhf.co/unsloth/functiongemma-270m-it-GGUF:IQ3_XXSollamaquantizer · unsloth0.2 GB—32.61
IQ2_M by unslothhf.co/unsloth/functiongemma-270m-it-GGUF:IQ2_Mollamaquantizer · unsloth0.2 GB—32.51
BF16 by unslothhf.co/unsloth/functiongemma-270m-it-GGUF:BF16ollamaquantizer · unsloth0.6 GB—18.71