Inference · hardware
What each kind of machine does.
Each kind of machine that signed a result here, with the fastest model it runs, the cheapest million tokens, and its parts as it benchmarked them.
20kinds of machine
36machines
13with a card
Nvidia
Apple
Intel
Amd
- Every number signed by the machine that measured it — check any one in your browser
- Open data: table.json · built 2026-11-12 18:03 UTC
- Every version, in git history
- How it is measured
Add your kind of machine A kind nobody has put on the network is a row nobody can read yet. Install a gram and it benchmarks its own parts.Who runs these machines The same results ranked by the people who own the machines.Every model, one table Each model with the machine that ran it fastest and cheapest.
| Machine | Machines · owners | Signed runs | Fastest model | Cheapest per M | Cardfp16 TFLOP/s, median | MemoryGB/s, median | Carbonper M tokens, median |
|---|---|---|---|---|---|---|---|
| Linux, CPU only · 4 CPUs·acbe75·e3654f·662a4e·4e94b2·5ac377·73d610·198875·fe1194·20d457·7e05a1·0da967·75e1cc·d83701·748763 | 14 · 14 | 153 | Forge-1-Mini1075 tok/s | $0.03Forge-1-Mini | — | 1.5 | 991 g |
| 2× Tesla T4·e61d3b·a5be46·c76d30 | 3 · 3 | 196 | Forge-1-Mini629 tok/s | $0.05Forge-1-Mini | 21.6 | 2.4 | 448 g |
| NVIDIA GeForce RTX 3080 Ti·84bf54 | 1 · 1 | 53 | DeepSeek-OCR 2 Base412 tok/s | $0.63DeepSeek-OCR 2 Base | 59.8 | 15.3 | 1.3 kg |
| NVIDIA L4·dae679 | 1 · 1 | 77 | FunctionGemma 270M341 tok/s | $0.63FunctionGemma 270M | 52.7 | 2.8 | 438 g |
| NVIDIA RTX PRO 6000 Blackwell Server Edition·e189d2 | 1 · 1 | 4 | Gemma 4 E2B291 tok/s | $2.01Gemma 4 E2B | 372.6 | 26.2 | 132 g |
| Apple M4·afbb8a | 1 · 1 | 44 | Llama 3.2 1B113 tok/s | $0.81Llama 3.2 1B | — | 42.7 | 740 g |
| Tesla T4·e78fd2 | 1 · 1 | 2 | Gemma 4 E2B78 tok/s | $1.78Gemma 4 E2B | — | — | — |
| Intel(R) UHD Graphics 730·9e3c79 | 1 · 1 | 68 | Gemma 3 270M52 tok/s | $1.38Gemma 3 270M | — | 5.2 | 737 g |
| NVIDIA GeForce RTX 3050 Laptop GPU·53b229 | 1 · 1 | 6 | Phi 4 Mini-Reasoning42 tok/s | $5.19Phi 4 Mini-Reasoning | — | 4.2 | — |
| Intel(R) Iris(R) Xe Graphics·2e5c02 | 1 · 1 | 35 | Gemma 3 270M41 tok/s | $1.72Gemma 3 270M | — | 3 | 4.1 kg |
| AMD Radeon(TM) Vega 8 Mobile Graphics·d061c9 | 1 · 1 | 17 | Gemma 3 270M27 tok/s | $6.41Gemma 3 270M | — | 6 | 3.4 kg |
| NVIDIA GeForce GTX 1650·12954d | 1 · 1 | 4 | Sarvam-123 tok/s | $7.51Sarvam-1 | — | — | — |
| Apple M1·0548a8·a5b1da | 2 · 2 | 10 | Llama 3.2 1B20 tok/s | $8.60Llama 3.2 1B | — | 25.3 | — |
| Windows, CPU only · 12 CPUs·9a1db0 | 1 · 1 | 8 | Gemma 4 E2B15 tok/s | $14Gemma 4 E2B | — | — | — |
| Apple silicon·d68672 | 1 · 1 | 25 | Llama 3.2 1B5 tok/s | $6.56Llama 3.2 1B | — | 4.6 | 1.1 kg |
| Mac, CPU only · 8 CPUs·0c5265 | 1 · 1 | 8 | — | — | — | — | — |
| Linux, CPU only · 6 CPUs·970094 | 1 · 1 | 5 | — | — | — | 1.1 | — |
| Linux, CPU only · 5 CPUs·92d334 | 1 · 1 | 6 | — | — | — | 15.5 | — |
| Linux, CPU only·15d9e9 | 1 · 1 | 3 | — | — | — | — | — |
| Linux, CPU only · 2 CPUs·c52689 | 1 · 1 | 0 | — | — | — | — | — |
Ranked by the fastest signed result. A dash is a part no machine of that kind has benchmarked and signed yet. Prices are the network's metered rates on each machine.