← Devstral Small

Devstral-Small-2-24B-Instruct-abliterated

No machine on this network has measured this model yet. Everything below is what the catalog knows exists — where the weights come from, how large each build is, and whose work it is. Nothing here is a claim about what the model can do; that only appears once a machine has run it and signed the result.

What it fits on

The smallest build needs about 9.9 GB; 10 of 18 kinds of machine on the network can hold it. Bars: each kind's memory (its card's, else RAM) · ticks: every build, at the size it held plus a fifth for the prompt.

  1. Linux, CPU only · 2 CPUs1 GB RAMnone
  2. NVIDIA GeForce RTX 3050 Laptop GPU4 GB on the cardnone
  3. NVIDIA GeForce GTX 16504 GB on the cardnone
  4. AMD Radeon(TM) Vega 8 Mobile Graphics7 GB RAMnone
  5. Windows, CPU only · 12 CPUs7 GB RAMnone
  6. Apple silicon8 GB RAMnone
  7. Apple M18 GB RAMnone
  8. Mac, CPU only · 8 CPUs8 GB RAMnone
  9. NVIDIA GeForce RTX 3080 Ti12 GB on the card2 of 6
  10. Tesla T415 GB on the card3 of 6
  11. Intel(R) UHD Graphics 73016 GB RAM4 of 6
  12. Intel(R) Iris(R) Xe Graphics16 GB RAM4 of 6
  13. Apple M416 GB RAM4 of 6
  14. Apple M116 GB RAM4 of 6
  15. NVIDIA L422 GB on the card5 of 6
  16. 2× Tesla T429 GB on the cardevery build
  17. Linux, CPU only · 4 CPUs31 GB RAMevery build
  18. NVIDIA RTX PRO 6000 Blackwell Server Edition95 GB on the cardevery build
hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q2_Kollama · Q2_K · 8.3 GiB · derivative (mradermacher)
hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q3_K_Sollama · Q3_K_S · 9.7 GiB · derivative (mradermacher)
hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q3_K_Lollama · Q3_K_L · 11.5 GiB · derivative (mradermacher)
hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q4_K_Sollama · Q4_K_S · 12.6 GiB · derivative (mradermacher)
hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q4_K_Mollama · Q4_K_M · 13.3 GiB · derivative (mradermacher)
hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q8_0ollama · Q8_0 · 23.3 GiB · derivative (mradermacher)