← Kimi K2
Kimi K2 logo

Qwen3-32B-Kimi-K2-Thinking-Distill

No machine on this network has measured this model yet. Everything below is what the catalog knows exists — where the weights come from, how large each build is, and whose work it is. Nothing here is a claim about what the model can do; that only appears once a machine has run it and signed the result.

What it fits on

The smallest build needs about 8.2 GB; 10 of 18 kinds of machine on the network can hold it. Bars: each kind's memory (its card's, else RAM) · ticks: every build, at the size it held plus a fifth for the prompt.

  1. Linux, CPU only · 2 CPUs1 GB RAMnone
  2. NVIDIA GeForce RTX 3050 Laptop GPU4 GB on the cardnone
  3. NVIDIA GeForce GTX 16504 GB on the cardnone
  4. AMD Radeon(TM) Vega 8 Mobile Graphics7 GB RAMnone
  5. Windows, CPU only · 12 CPUs7 GB RAMnone
  6. Apple silicon8 GB RAMnone
  7. Apple M18 GB RAMnone
  8. Mac, CPU only · 8 CPUs8 GB RAMnone
  9. NVIDIA GeForce RTX 3080 Ti12 GB on the card2 of 8
  10. Tesla T415 GB on the card3 of 8
  11. Intel(R) UHD Graphics 73016 GB RAM3 of 8
  12. Intel(R) Iris(R) Xe Graphics16 GB RAM3 of 8
  13. Apple M416 GB RAM3 of 8
  14. Apple M116 GB RAM3 of 8
  15. NVIDIA L422 GB on the card4 of 8
  16. 2× Tesla T429 GB on the card5 of 8
  17. Linux, CPU only · 4 CPUs31 GB RAM5 of 8
  18. NVIDIA RTX PRO 6000 Blackwell Server Edition95 GB on the cardevery build
hf.co/mradermacher/Qwen3-32B-Kimi-K2-Thinking-Distill-i1-GGUF:IQ1_Sollama · IQ1_S · 6.8 GiB · derivative (mradermacher)
hf.co/mradermacher/Qwen3-32B-Kimi-K2-Thinking-Distill-i1-GGUF:IQ2_XXSollama · IQ2_XXS · 8.4 GiB · derivative (mradermacher)
hf.co/mradermacher/Qwen3-32B-Kimi-K2-Thinking-Distill-i1-GGUF:IQ3_XXSollama · IQ3_XXS · 11.9 GiB · derivative (mradermacher)
hf.co/mradermacher/Qwen3-32B-Kimi-K2-Thinking-Distill-i1-GGUF:Q4_0ollama · Q4_0 · 17.4 GiB · derivative (mradermacher)
hf.co/mradermacher/Qwen3-32B-Kimi-K2-Thinking-Distill-i1-GGUF:Q4_K_Mollama · Q4_K_M · 18.4 GiB · derivative (mradermacher)
hf.co/TeichAI/Qwen3-32B-Kimi-K2-Thinking-Distill-GGUF:Q8_0ollama · Q8_0 · 32.4 GiB · derivative (TeichAI)
hf.co/TeichAI/Qwen3-32B-Kimi-K2-Thinking-Distill-GGUF:BF16ollama · BF16 · 61.0 GiB · derivative (TeichAI)
hf.co/TeichAI/Qwen3-32B-Kimi-K2-Thinking-Distill-GGUF:F16ollama · F16 · 61.0 GiB · derivative (TeichAI)