yujiepan/kimi-k2-tiny-randomBF16vllmderived by yujiepan
hf.co/mradermacher/DialoGPT-medium-distill-Kimi-K2-Instruct-GGUF:Q2_KQ2_Kollamaderived by mradermacher
hf.co/mradermacher/DialoGPT-medium-distill-Kimi-K2-Instruct-GGUF:Q3_K_SQ3_K_Sollamaderived by mradermacher
hf.co/mradermacher/DialoGPT-medium-distill-Kimi-K2-Instruct-GGUF:IQ4_XSIQ4_XSollamaderived by mradermacher
hf.co/mradermacher/DialoGPT-medium-distill-Kimi-K2-Instruct-GGUF:Q4_K_SQ4_K_Sollamaderived by mradermacher
hf.co/mradermacher/DialoGPT-medium-distill-Kimi-K2-Instruct-GGUF:Q4_K_MQ4_K_Mollamaderived by mradermacher
hf.co/mradermacher/DialoGPT-medium-distill-Kimi-K2-Instruct-GGUF:Q8_0Q8_0ollamaderived by mradermacher
hf.co/mradermacher/DialoGPT-medium-distill-Kimi-K2-Instruct-GGUF:F16F16ollamaderived by mradermacher
hf.co/mradermacher/Qwen3-4B-Thinking-2507-Kimi-K2-Thinking-Distill-i1-GGUF:IQ1_SIQ1_Sollamaderived by mradermacher
hf.co/mradermacher/Qwen3-4B-Thinking-2507-Kimi-K2-Thinking-Distill-i1-GGUF:IQ2_XXSIQ2_XXSollamaderived by mradermacher
Fu01978/DialoGPT-medium-distill-Kimi-K2-InstructFP32vllmderived by Fu01978
hf.co/mradermacher/Qwen3-4B-Thinking-2507-Kimi-K2-Thinking-Distill-i1-GGUF:IQ3_XXSIQ3_XXSollamaderived by mradermacher
hf.co/mradermacher/Qwen3-4B-Thinking-2507-Kimi-K2-Thinking-Distill-i1-GGUF:Q4_0Q4_0ollamaderived by mradermacher
hf.co/mradermacher/Qwen3-4B-Thinking-2507-Kimi-K2-Thinking-Distill-i1-GGUF:Q4_K_MQ4_K_Mollamaderived by mradermacher
nvidia/Kimi-K2-Thinking-Eagle3BF16vllmderived by nvidia
hf.co/mradermacher/Qwen3-32B-Kimi-K2-Thinking-Distill-i1-GGUF:IQ1_SIQ1_Sollamaderived by mradermacher
hf.co/mradermacher/Qwen3-32B-Kimi-K2-Thinking-Distill-i1-GGUF:IQ2_XXSIQ2_XXSollamaderived by mradermacher
nightmedia/gemma-3-12b-it-vl-Kimi-K2-Heretic-Uncensored-Thinking-qx86-hi-mlx8BITmlxderived by nightmedia
hf.co/mradermacher/Qwen3-32B-Kimi-K2-Thinking-Distill-i1-GGUF:IQ3_XXSIQ3_XXSollamaderived by mradermacher
hf.co/mradermacher/Qwen3-32B-Kimi-K2-Thinking-Distill-i1-GGUF:Q4_0Q4_0ollamaderived by mradermacher
hf.co/mradermacher/Qwen3-32B-Kimi-K2-Thinking-Distill-i1-GGUF:Q4_K_MQ4_K_Mollamaderived by mradermacher
hf.co/TeichAI/Qwen3-32B-Kimi-K2-Thinking-Distill-GGUF:Q8_0Q8_0ollamaderived by TeichAI
hf.co/TeichAI/Qwen3-32B-Kimi-K2-Thinking-Distill-GGUF:BF16BF16ollamaderived by TeichAI
hf.co/TeichAI/Qwen3-32B-Kimi-K2-Thinking-Distill-GGUF:F16F16ollamaderived by TeichAI
unsloth/Kimi-K2-Instruct-GGUF:IQ1_SIQ1_Sllamacppquantized by unsloth
unsloth/Kimi-K2-Instruct-0905-GGUF:IQ1_SIQ1_Sllamacppquantized by unsloth
unsloth/Kimi-K2-Thinking-GGUF:IQ1_SIQ1_Sllamacppquantized by unsloth
richardyoung/Kimi-K2-Instruct-0905-MLX-2bit2BITmlxquantized by richardyoung
unsloth/Kimi-K2-Instruct-GGUF:IQ2_XXSIQ2_XXSllamacppquantized by unsloth
unsloth/Kimi-K2-Instruct-0905-GGUF:IQ2_XXSIQ2_XXSllamacppquantized by unsloth
unsloth/Kimi-K2-Thinking-GGUF:IQ2_XXSIQ2_XXSllamacppquantized by unsloth
unsloth/Kimi-K2-Instruct-GGUF:IQ3_XXSIQ3_XXSllamacppquantized by unsloth
unsloth/Kimi-K2-Instruct-0905-GGUF:IQ3_XXSIQ3_XXSllamacppquantized by unsloth
unsloth/Kimi-K2-Thinking-GGUF:IQ3_XXSIQ3_XXSllamacppquantized by unsloth
mlx-community/moonshotai_Kimi-K2-Instruct-mlx-3bit3BITmlxquantized by mlx-community
mlx-community/Kimi-K2-Instruct-0905-mlx-DQ3_K_M4BITmlxderived by mlx-community
luisra/Kimi-K2-Instruct-4bitBITSANDBYTESvllmquantized by luisra
UnicornChan/Kimi-K2-GPTQ-4b-128g-expertsW4A16vllmderived by UnicornChan
amd/Kimi-K2-Instruct-0905-MXFP4QUARKvllmquantized by amd
mlx-community/Kimi-K2-Instruct-4bit4BITmlxquantized by mlx-community
richardyoung/Kimi-K2-Instruct-0905-MLX-4bit4BITmlxquantized by richardyoung
unsloth/Kimi-K2-Instruct-GGUF:Q4_0Q4_0llamacppquantized by unsloth
unsloth/Kimi-K2-Instruct-0905-GGUF:Q4_0Q4_0llamacppquantized by unsloth
unsloth/Kimi-K2-Thinking-GGUF:Q4_0Q4_0llamacppquantized by unsloth
baseten/Kimi-K2-Instruct-FP4FP8vllmderived by baseten
moonshotai/Kimi-K2-ThinkingW4A16vllmpublished by moonshotai
nvidia/Kimi-K2-Thinking-NVFP4NVFP4vllmquantized by nvidia
unsloth/Kimi-K2-Instruct-GGUF:Q4_K_MQ4_K_Mllamacppquantized by unsloth
unsloth/Kimi-K2-Instruct-0905-GGUF:Q4_K_MQ4_K_Mllamacppquantized by unsloth
unsloth/Kimi-K2-Thinking-GGUF:Q4_K_MQ4_K_Mllamacppquantized by unsloth
mlx-community/Kimi-K2-Thinking4BITmlxquantized by mlx-community
richardyoung/Kimi-K2-Instruct-0905-MLX-5bit5BITmlxderived by richardyoung
richardyoung/Kimi-K2-Instruct-0905-MLX-6bit6BITmlxquantized by richardyoung
moonshotai/Kimi-K2-InstructFP8vllmpublished by moonshotai
moonshotai/Kimi-K2-Instruct-0905FP8vllmpublished by moonshotai
moonshotai/Kimi-K2-BaseFP8vllmpublished by moonshotai
richardyoung/Kimi-K2-Instruct-0905-MLX-8bit8BITmlxquantized by richardyoung
unsloth/Kimi-K2-Instruct-GGUF:Q8_0Q8_0llamacppquantized by unsloth
unsloth/Kimi-K2-Instruct-0905-GGUF:Q8_0Q8_0llamacppquantized by unsloth
unsloth/Kimi-K2-Thinking-GGUF:Q8_0Q8_0llamacppquantized by unsloth
DevQuasar/moonshotai.Kimi-K2-Instruct-BF16BF16vllmderived by DevQuasar
unsloth/Kimi-K2-Instruct-GGUF:BF16BF16llamacppquantized by unsloth
unsloth/Kimi-K2-Instruct-0905-GGUF:BF16BF16llamacppquantized by unsloth
unsloth/Kimi-K2-Thinking-GGUF:BF16BF16llamacppquantized by unsloth
Sizes are what the catalog declares, not what a machine measured — fitting on disk is necessary and not sufficient. Nobody here has run these on your machine, and this narrows the candidates rather than certifying one.