family member
Hunyuan MT 2 logo

Hunyuan MT 2 30B-A3B

5.4 tokens a second on Linux · no GPU · 4 CPUs · 31 GB RAM. About $8.31 per million tokens here, against OpenRouter's $0.29: the API is 28× cheaper. Run it here for privacy or to keep work on your own machines, not to save money.

1 build of Hunyuan MT 2 30B-A3B, 2 signed runs on real machines: different packagers, precisions and engines, each a different file with its own numbers.

5.4tok/s, fastest machine
$8.31per M tokens · $0.29 on an API
4Kcontext proved by recall
20.9 GBmemory, smallest build
2providers measured it
best on ollama · 1 build

trained 256K · proved 4K context, by tencent Q4_K_M

5.4 tok/s peak, by tencent Q4_K_M

What it fits on

The smallest build needs about 20.9 GB; 4 of 18 kinds of machine on the network can hold it. Bars: each kind's memory (its card's, else RAM) · ticks: every build, at the size it held plus a fifth for the prompt.

  1. Linux, CPU only · 2 CPUs1 GB RAMnone
  2. NVIDIA GeForce RTX 3050 Laptop GPU4 GB on the cardnone
  3. NVIDIA GeForce GTX 16504 GB on the cardnone
  4. AMD Radeon(TM) Vega 8 Mobile Graphics7 GB RAMnone
  5. Windows, CPU only · 12 CPUs7 GB RAMnone
  6. Apple silicon8 GB RAMnone
  7. Apple M18 GB RAMnone
  8. Mac, CPU only · 8 CPUs8 GB RAMnone
  9. NVIDIA GeForce RTX 3080 Ti12 GB on the cardnone
  10. Tesla T415 GB on the cardnone
  11. Intel(R) UHD Graphics 73016 GB RAMnone
  12. Intel(R) Iris(R) Xe Graphics16 GB RAMnone
  13. Apple M416 GB RAMnone
  14. Apple M116 GB RAMnone
  15. NVIDIA L422 GB on the cardevery build
  16. 2× Tesla T429 GB on the cardevery build
  17. Linux, CPU only · 4 CPUs31 GB RAMevery build
  18. NVIDIA RTX PRO 6000 Blackwell Server Edition95 GB on the cardevery build

How far back it remembers, machine by machine

Filled: the needle came back at that prompt size · outlined: asked and lost · blank: not asked · trained for 256K. 0 walks ended because the model forgot, 2 because the machine could not hold the prompt.

machine · build4Kwhy it stopped
Gram ·e61d3b2× Tesla T4 · Q4_K_M by tencent4K too slow to answer here
Gram ·e3654fLinux, CPU only · 4 CPUs · Q4_K_M by tencent4K too slow to answer here

Carbon per million tokens

Lowest build on each machine · 0 of 2 read off a power sensor, the rest modelled from the parts · fewer grams is better

  1. Gram ·e61d3b3.2 kg53.36 J/tok · modelled
  2. Gram ·e3654f3.6 kg60.02 J/tok · modelled

Carbon is location-based: signed energy × the yearly average of the grid where the machine signed its place (EU grid average (applied to NL); Ember Global Electricity Review 2025 (2024 generation), location-based). Facility overhead is not included. A machine on its own solar is not credited until it can prove it.

Measured by

The people whose machines signed these numbers

proved by at least one build: Structured output · Sustained output · Writes code · Reasons about code · Synthesises sources · Follows instructions

Every build

Each its own file with its own page: the machines that ran it and their signatures.

buildenginewhose workmemorycontext provedbest tok/smachines
Q4_K_M by tencenthf.co/tencent/Hy-MT2-30B-A3B-GGUF:Q4_K_Mollamavendor · tencent20.9 GB4K5.42
derivatives — somebody else's change to these weights

Fine-tunes, merges and abliterations of this member, each its own model with its own page. None of their numbers are counted above.