4 builds of embeddinggemma-300m-gguf, 4 signed runs on real machines: different packagers, precisions and engines, each a different file with its own numbers.
no context proved on this engine yet
What it fits on
The smallest build needs about 0.3 GB; 18 of 18 kinds of machine on the network can hold it. Bars: each kind's memory (its card's, else RAM) · ticks: every build, at the size it held plus a fifth for the prompt.
Measured by
The people whose machines signed these numbers
proved by at least one build: Embeddings
Each its own file with its own page: the machines that ran it and their signatures.
| build | engine | whose work | memory | context proved | best tok/s | machines |
|---|---|---|---|---|---|---|
| F16 by lm-kithf.co/lm-kit/embeddinggemma-300m-gguf:F16 | ollama | derivative · lm-kit | 0.8 GB | — | — | 1 |
| Q4_K_M by lm-kithf.co/lm-kit/embeddinggemma-300m-gguf:Q4_K_M | ollama | derivative · lm-kit | 0.3 GB | — | — | 1 |
| Q5_K_M by lm-kithf.co/lm-kit/embeddinggemma-300m-gguf:Q5_K_M | ollama | derivative · lm-kit | 0.4 GB | — | — | 1 |
| Q8_0 by lm-kithf.co/lm-kit/embeddinggemma-300m-gguf:Q8_0 | ollama | derivative · lm-kit | 0.4 GB | — | — | 1 |