model family
Granite 4.2 logo

Granite 4.2

Published by ibm-granite. 3 members measured on real machines, across 3 builds. Every number below was signed by the machine that produced it — none of it is from a model card.

what it takes, what it returns
text → text

Declared by the network’s catalog, not measured — a signature says what this family would be asked. Whether it answered is the signed capability flags on each member.

3 of 66 builds measured · 63 still open
what each build proved
3b · Q4_K_M
30b · Q4_K_M
8b · Q4_K_M
3b · Q4_K_M · Tool calling — proved3b · Q4_K_M · Tool loop finished — proved3b · Q4_K_M · Faithful to tool results — proved3b · Q4_K_M · Chained tool calls — proved3b · Q4_K_M · Structured output — proved3b · Q4_K_M · Sustained output — proved3b · Q4_K_M · Extended thinking — proved3b · Q4_K_M · Writes code — proved3b · Q4_K_M · Reasons about code — proved3b · Q4_K_M · Synthesises sources — proved3b · Q4_K_M · Follows instructions — proved30b · Q4_K_M · Tool calling — never asked30b · Q4_K_M · Tool loop finished — never asked30b · Q4_K_M · Faithful to tool results — never asked30b · Q4_K_M · Chained tool calls — never asked30b · Q4_K_M · Structured output — never asked30b · Q4_K_M · Sustained output — never asked30b · Q4_K_M · Extended thinking — never asked30b · Q4_K_M · Writes code — never asked30b · Q4_K_M · Reasons about code — never asked30b · Q4_K_M · Synthesises sources — never asked30b · Q4_K_M · Follows instructions — never asked8b · Q4_K_M · Tool calling — never asked8b · Q4_K_M · Tool loop finished — never asked8b · Q4_K_M · Faithful to tool results — never asked8b · Q4_K_M · Chained tool calls — never asked8b · Q4_K_M · Structured output — never asked8b · Q4_K_M · Sustained output — never asked8b · Q4_K_M · Extended thinking — never asked8b · Q4_K_M · Writes code — never asked8b · Q4_K_M · Reasons about code — never asked8b · Q4_K_M · Synthesises sources — never asked8b · Q4_K_M · Follows instructions — never asked
Tool calling
Tool loop finished
Faithful to tool results
Chained tool calls
Structured output
Sustained output
Extended thinking
Writes code
Reasons about code
Synthesises sources
Follows instructions
Granite 4.2 3B1 build measured →
hf.co/ibm-granite/granite-4.2-3b-GGUF:Q4_K_M3b · Q4_K_M · ibm-granite · ollama · 3 machines · 3.66B
32Krecalled
—served
16.9best tok/s
16.9 tok/s · unnamed machine3.5 tok/s · x86 · CPU · Hyderabad2.9 tok/s · unnamed machine
2.9 → 16.9 tok/s across 3 machines · ×5.9 spreadunnamed machinex86 · CPU
recalled 32k⌐ declared 128k · unsignedadvertises 4× what it proved
Granite 4.2 30B1 build measured →
hf.co/ibm-granite/granite-4.2-30b-GGUF:Q4_K_M30b · Q4_K_M · ibm-granite · ollama · 1 machine
—recalled
—served
0.7best tok/s
Granite 4.2 8B1 build measured →
hf.co/ibm-granite/granite-4.2-8b-GGUF:Q4_K_M8b · Q4_K_M · ibm-granite · ollama · 1 machine
—recalled
—served
1.9best tok/s

Builds this network knows of

Declared, not measured — this is what the catalog says exists and what it would cost a machine to hold. Nothing here is signed, and none of it claims the build works.

how much memory does your machine have

51 of 66 builds fit a 16 GB machine — budgeting 70% of it, or 11.2 GiB, because the cache and the runtime want the rest.

  • hf.co/mradermacher/Granite-4.2-3B-Surgical-Abliterated-i1-GGUF:IQ1_SIQ1_Sollamaderived by mradermacher
    0.9 GiB
  • hf.co/mradermacher/Granite-4.2-3B-Surgical-Abliterated-i1-GGUF:IQ2_XXSIQ2_XXSollamaderived by mradermacher
    1.0 GiB
  • hf.co/ibm-granite/granite-4.2-3b-GGUF:Q2_KQ2_Kollamapublished by ibm-granite
    1.4 GiB
  • hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:Q2_KQ2_Kollamaderived by taronaeo
    1.4 GiB
  • hf.co/mradermacher/Granite-4.2-3B-Surgical-Abliterated-i1-GGUF:IQ3_XXSIQ3_XXSollamaderived by mradermacher
    1.4 GiB
  • hf.co/ibm-granite/granite-4.2-3b-GGUF:Q3_K_SQ3_K_Sollamapublished by ibm-granite
    1.6 GiB
  • hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:Q3_K_SQ3_K_Sollamaderived by taronaeo
    1.6 GiB
  • hf.co/ibm-granite/granite-4.2-3b-GGUF:Q3_K_LQ3_K_Lollamapublished by ibm-granite
    1.8 GiB
  • hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:Q3_K_LQ3_K_Lollamaderived by taronaeo
    1.8 GiB
  • lmstudio-community/granite-4.2-3b-MLX-4bit4BITmlxquantized by lmstudio-community
    1.9 GiB
  • hf.co/mradermacher/Granite-4.2-8B-Surgical-Abliterated-i1-GGUF:IQ1_SIQ1_Sollamaderived by mradermacher
    2.0 GiB
  • hf.co/mradermacher/granite-4.2-8b-i1-GGUF:IQ1_SIQ1_Sollamaderived by mradermacher
    2.0 GiB
  • hf.co/ibm-granite/granite-4.2-3b-GGUF:Q4_0Q4_0ollamapublished by ibm-granite
    2.0 GiB
  • hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:Q4_0Q4_0ollamaderived by taronaeo
    2.0 GiB
  • hf.co/mradermacher/Granite-4.2-3B-Surgical-Abliterated-i1-GGUF:Q4_0Q4_0ollamaderived by mradermacher
    2.0 GiB
  • hf.co/ibm-granite/granite-4.2-3b-GGUF:Q4_K_MQ4_K_Mollamameasured herepublished by ibm-granite
    2.1 GiB
  • hf.co/mradermacher/Granite-4.2-3B-Surgical-Abliterated-i1-GGUF:Q4_K_MQ4_K_Mollamaderived by mradermacher
    2.1 GiB
  • hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:Q4_K_MQ4_K_Mollamaderived by taronaeo
    2.1 GiB
  • hf.co/mradermacher/Granite-4.2-8B-Surgical-Abliterated-i1-GGUF:IQ2_XXSIQ2_XXSollamaderived by mradermacher
    2.4 GiB
  • hf.co/mradermacher/granite-4.2-8b-i1-GGUF:IQ2_XXSIQ2_XXSollamaderived by mradermacher
    2.4 GiB
  • ibm-granite/granite-4.2-3b-mxfp4W4A4vllmpublished by ibm-granite
    2.5 GiB
  • ibm-granite/granite-4.2-3b-nvfp4W4A4vllmpublished by ibm-granite
    2.6 GiB
  • hf.co/ibm-granite/granite-4.2-8b-GGUF:Q2_KQ2_Kollamapublished by ibm-granite
    3.2 GiB
  • hf.co/mradermacher/Granite-4.2-8B-Surgical-Abliterated-i1-GGUF:IQ3_XXSIQ3_XXSollamaderived by mradermacher
    3.3 GiB
  • hf.co/mradermacher/granite-4.2-8b-i1-GGUF:IQ3_XXSIQ3_XXSollamaderived by mradermacher
    3.3 GiB
  • ibm-granite/granite-4.2-3b-q8-mlx8BITmlxpublished by ibm-granite
    3.6 GiB
  • hf.co/ibm-granite/granite-4.2-3b-GGUF:Q8_0Q8_0ollamapublished by ibm-granite
    3.6 GiB
  • hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:Q8_0Q8_0ollamaderived by taronaeo
    3.6 GiB
  • hf.co/ibm-granite/granite-4.2-8b-GGUF:Q3_K_SQ3_K_Sollamapublished by ibm-granite
    3.7 GiB
  • ibm-granite/granite-4.2-3b-fp8FP8vllmpublished by ibm-granite
    3.9 GiB
  • hf.co/ibm-granite/granite-4.2-8b-GGUF:Q3_K_LQ3_K_Lollamapublished by ibm-granite
    4.4 GiB
  • lmstudio-community/granite-4.2-8b-MLX-4bit4BITmlxquantized by lmstudio-community
    4.6 GiB
  • hf.co/ibm-granite/granite-4.2-8b-GGUF:Q4_0Q4_0ollamapublished by ibm-granite
    4.7 GiB
  • hf.co/mradermacher/Granite-4.2-8B-Surgical-Abliterated-i1-GGUF:Q4_0Q4_0ollamaderived by mradermacher
    4.7 GiB
  • hf.co/mradermacher/granite-4.2-8b-i1-GGUF:Q4_0Q4_0ollamaderived by mradermacher
    4.7 GiB
  • hf.co/ibm-granite/granite-4.2-8b-GGUF:Q4_K_MQ4_K_Mollamameasured herepublished by ibm-granite
    5.0 GiB
  • hf.co/mradermacher/Granite-4.2-8B-Surgical-Abliterated-i1-GGUF:Q4_K_MQ4_K_Mollamaderived by mradermacher
    5.0 GiB
  • hf.co/mradermacher/granite-4.2-8b-i1-GGUF:Q4_K_MQ4_K_Mollamaderived by mradermacher
    5.0 GiB
  • ibm-granite/granite-4.2-8b-nvfp4W4A4vllmpublished by ibm-granite
    5.7 GiB
  • hf.co/mradermacher/granite-4.2-30b-i1-GGUF:IQ1_SIQ1_Sollamaderived by mradermacher
    5.9 GiB
  • ibm-granite/granite-4.2-3b-bf16-mlxBF16mlxpublished by ibm-granite
    6.8 GiB
  • saidutta69/granite-4.2-3b-hereticBF16vllmderived by saidutta69
    6.8 GiB
  • hf.co/ibm-granite/granite-4.2-3b-GGUF:BF16BF16ollamapublished by ibm-granite
    6.8 GiB
  • hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:BF16BF16ollamaderived by taronaeo
    6.8 GiB
  • hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:F16F16ollamaderived by taronaeo
    6.8 GiB
  • hf.co/mradermacher/granite-4.2-30b-i1-GGUF:IQ2_XXSIQ2_XXSollamaderived by mradermacher
    7.4 GiB
  • lmstudio-community/granite-4.2-8b-MLX-8bit8BITmlxquantized by lmstudio-community
    8.7 GiB
  • hf.co/ibm-granite/granite-4.2-8b-GGUF:Q8_0Q8_0ollamapublished by ibm-granite
    8.7 GiB
  • ibm-granite/granite-4.2-8b-fp8FP8vllmpublished by ibm-granite
    9.0 GiB
  • hf.co/ibm-granite/granite-4.2-30b-GGUF:Q2_KQ2_Kollamapublished by ibm-granite
    10.1 GiB
  • hf.co/mradermacher/granite-4.2-30b-i1-GGUF:IQ3_XXSIQ3_XXSollamaderived by mradermacher
    10.6 GiB
  • hf.co/ibm-granite/granite-4.2-30b-GGUF:Q3_K_SQ3_K_Sollamapublished by ibm-granite
    11.9 GiB
  • hf.co/ibm-granite/granite-4.2-30b-GGUF:Q3_K_LQ3_K_Lollamapublished by ibm-granite
    14.3 GiB
  • ibm-granite/granite-4.2-30b-q4-mlx4BITmlxpublished by ibm-granite
    15.3 GiB
  • hf.co/ibm-granite/granite-4.2-30b-GGUF:Q4_0Q4_0ollamapublished by ibm-granite
    15.4 GiB
  • hf.co/mradermacher/granite-4.2-30b-i1-GGUF:Q4_0Q4_0ollamaderived by mradermacher
    15.5 GiB
  • ibm-granite/granite-4.2-8b-bf16-mlxBF16mlxpublished by ibm-granite
    16.4 GiB
  • saidutta69/granite-4.2-8b-hereticBF16vllmderived by saidutta69
    16.4 GiB
  • hf.co/ibm-granite/granite-4.2-8b-GGUF:BF16BF16ollamapublished by ibm-granite
    16.4 GiB
  • ibm-granite/granite-4.2-30b-nvfp4W4A4vllmpublished by ibm-granite
    16.4 GiB
  • hf.co/ibm-granite/granite-4.2-30b-GGUF:Q4_K_MQ4_K_Mollamameasured herepublished by ibm-granite
    16.5 GiB
  • hf.co/mradermacher/granite-4.2-30b-i1-GGUF:Q4_K_MQ4_K_Mollamaderived by mradermacher
    16.5 GiB
  • ibm-granite/granite-4.2-30b-q8-mlx8BITmlxpublished by ibm-granite
    29.0 GiB
  • hf.co/ibm-granite/granite-4.2-30b-GGUF:Q8_0Q8_0ollamapublished by ibm-granite
    29.0 GiB
  • ibm-granite/granite-4.2-30b-bf16-mlxBF16mlxpublished by ibm-granite
    54.5 GiB
  • ibm-granite/granite-4.2-30b-GGUF:BF16BF16llamacpppublished by ibm-granite
    54.5 GiB

Sizes are what the catalog declares, not what a machine measured — fitting on disk is necessary and not sufficient. Nobody here has run these on your machine, and this narrows the candidates rather than certifying one.

the same builds, by member
Granite 4.2 30B
hf.co/ibm-granite/granite-4.2-30b-GGUF:Q2_KQ2_Kollama10.1 GiB on diskpublished by ibm-granite
hf.co/ibm-granite/granite-4.2-30b-GGUF:Q3_K_SQ3_K_Sollama11.9 GiB on diskpublished by ibm-granite
hf.co/ibm-granite/granite-4.2-30b-GGUF:Q3_K_LQ3_K_Lollama14.3 GiB on diskpublished by ibm-granite
ibm-granite/granite-4.2-30b-q4-mlx4BITmlx15.3 GiB on diskpublished by ibm-granite
hf.co/ibm-granite/granite-4.2-30b-GGUF:Q4_0Q4_0ollama15.4 GiB on diskpublished by ibm-granite
ibm-granite/granite-4.2-30b-nvfp4W4A4vllm16.4 GiB on diskpublished by ibm-granite
hf.co/ibm-granite/granite-4.2-30b-GGUF:Q4_K_MQ4_K_Mollama16.5 GiB on diskpublished by ibm-granite
ibm-granite/granite-4.2-30b-q8-mlx8BITmlx29.0 GiB on diskpublished by ibm-granite
hf.co/ibm-granite/granite-4.2-30b-GGUF:Q8_0Q8_0ollama29.0 GiB on diskpublished by ibm-granite
ibm-granite/granite-4.2-30b-bf16-mlxBF16mlx54.5 GiB on diskpublished by ibm-granite
ibm-granite/granite-4.2-30b-GGUF:BF16BF16llamacpp54.5 GiB on diskpublished by ibm-granite
granite-4.2-30b-i1-GGUF
hf.co/mradermacher/granite-4.2-30b-i1-GGUF:IQ1_SIQ1_Sollama5.9 GiB on diskderived by mradermacher
hf.co/mradermacher/granite-4.2-30b-i1-GGUF:IQ2_XXSIQ2_XXSollama7.4 GiB on diskderived by mradermacher
hf.co/mradermacher/granite-4.2-30b-i1-GGUF:IQ3_XXSIQ3_XXSollama10.6 GiB on diskderived by mradermacher
hf.co/mradermacher/granite-4.2-30b-i1-GGUF:Q4_0Q4_0ollama15.5 GiB on diskderived by mradermacher
hf.co/mradermacher/granite-4.2-30b-i1-GGUF:Q4_K_MQ4_K_Mollama16.5 GiB on diskderived by mradermacher
Granite 4.2 3B
hf.co/ibm-granite/granite-4.2-3b-GGUF:Q2_KQ2_Kollama1.4 GiB on diskpublished by ibm-granite
hf.co/ibm-granite/granite-4.2-3b-GGUF:Q3_K_SQ3_K_Sollama1.6 GiB on diskpublished by ibm-granite
hf.co/ibm-granite/granite-4.2-3b-GGUF:Q3_K_LQ3_K_Lollama1.8 GiB on diskpublished by ibm-granite
lmstudio-community/granite-4.2-3b-MLX-4bit4BITmlx1.9 GiB on diskquantized by lmstudio-community
hf.co/ibm-granite/granite-4.2-3b-GGUF:Q4_0Q4_0ollama2.0 GiB on diskpublished by ibm-granite
hf.co/ibm-granite/granite-4.2-3b-GGUF:Q4_K_MQ4_K_Mollama2.1 GiB on diskpublished by ibm-granite
ibm-granite/granite-4.2-3b-mxfp4W4A4vllm2.5 GiB on diskpublished by ibm-granite
ibm-granite/granite-4.2-3b-nvfp4W4A4vllm2.6 GiB on diskpublished by ibm-granite
ibm-granite/granite-4.2-3b-q8-mlx8BITmlx3.6 GiB on diskpublished by ibm-granite
hf.co/ibm-granite/granite-4.2-3b-GGUF:Q8_0Q8_0ollama3.6 GiB on diskpublished by ibm-granite
ibm-granite/granite-4.2-3b-fp8FP8vllm3.9 GiB on diskpublished by ibm-granite
ibm-granite/granite-4.2-3b-bf16-mlxBF16mlx6.8 GiB on diskpublished by ibm-granite
hf.co/ibm-granite/granite-4.2-3b-GGUF:BF16BF16ollama6.8 GiB on diskpublished by ibm-granite
Granite-4.2-3B-Surgical-Abliterated
hf.co/mradermacher/Granite-4.2-3B-Surgical-Abliterated-i1-GGUF:IQ1_SIQ1_Sollama886 MiB on diskderived by mradermacher
hf.co/mradermacher/Granite-4.2-3B-Surgical-Abliterated-i1-GGUF:IQ2_XXSIQ2_XXSollama1.0 GiB on diskderived by mradermacher
hf.co/mradermacher/Granite-4.2-3B-Surgical-Abliterated-i1-GGUF:IQ3_XXSIQ3_XXSollama1.4 GiB on diskderived by mradermacher
hf.co/mradermacher/Granite-4.2-3B-Surgical-Abliterated-i1-GGUF:Q4_0Q4_0ollama2.0 GiB on diskderived by mradermacher
hf.co/mradermacher/Granite-4.2-3B-Surgical-Abliterated-i1-GGUF:Q4_K_MQ4_K_Mollama2.1 GiB on diskderived by mradermacher
granite-4.2-3b-heretic
saidutta69/granite-4.2-3b-hereticBF16vllm6.8 GiB on diskderived by saidutta69
Granite-4.2-3B-BE-GGUF
hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:Q2_KQ2_Kollama1.4 GiB on diskderived by taronaeo
hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:Q3_K_SQ3_K_Sollama1.6 GiB on diskderived by taronaeo
hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:Q3_K_LQ3_K_Lollama1.8 GiB on diskderived by taronaeo
hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:Q4_0Q4_0ollama2.0 GiB on diskderived by taronaeo
hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:Q4_K_MQ4_K_Mollama2.1 GiB on diskderived by taronaeo
hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:Q8_0Q8_0ollama3.6 GiB on diskderived by taronaeo
hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:BF16BF16ollama6.8 GiB on diskderived by taronaeo
hf.co/taronaeo/Granite-4.2-3B-BE-GGUF:F16F16ollama6.8 GiB on diskderived by taronaeo
Granite 4.2 8B
hf.co/ibm-granite/granite-4.2-8b-GGUF:Q2_KQ2_Kollama3.2 GiB on diskpublished by ibm-granite
hf.co/ibm-granite/granite-4.2-8b-GGUF:Q3_K_SQ3_K_Sollama3.7 GiB on diskpublished by ibm-granite
hf.co/ibm-granite/granite-4.2-8b-GGUF:Q3_K_LQ3_K_Lollama4.4 GiB on diskpublished by ibm-granite
lmstudio-community/granite-4.2-8b-MLX-4bit4BITmlx4.6 GiB on diskquantized by lmstudio-community
hf.co/ibm-granite/granite-4.2-8b-GGUF:Q4_0Q4_0ollama4.7 GiB on diskpublished by ibm-granite
hf.co/ibm-granite/granite-4.2-8b-GGUF:Q4_K_MQ4_K_Mollama5.0 GiB on diskpublished by ibm-granite
ibm-granite/granite-4.2-8b-nvfp4W4A4vllm5.7 GiB on diskpublished by ibm-granite
lmstudio-community/granite-4.2-8b-MLX-8bit8BITmlx8.7 GiB on diskquantized by lmstudio-community
hf.co/ibm-granite/granite-4.2-8b-GGUF:Q8_0Q8_0ollama8.7 GiB on diskpublished by ibm-granite
ibm-granite/granite-4.2-8b-fp8FP8vllm9.0 GiB on diskpublished by ibm-granite
ibm-granite/granite-4.2-8b-bf16-mlxBF16mlx16.4 GiB on diskpublished by ibm-granite
hf.co/ibm-granite/granite-4.2-8b-GGUF:BF16BF16ollama16.4 GiB on diskpublished by ibm-granite
Granite-4.2-8B-Surgical-Abliterated
hf.co/mradermacher/Granite-4.2-8B-Surgical-Abliterated-i1-GGUF:IQ1_SIQ1_Sollama2.0 GiB on diskderived by mradermacher
hf.co/mradermacher/Granite-4.2-8B-Surgical-Abliterated-i1-GGUF:IQ2_XXSIQ2_XXSollama2.4 GiB on diskderived by mradermacher
hf.co/mradermacher/Granite-4.2-8B-Surgical-Abliterated-i1-GGUF:IQ3_XXSIQ3_XXSollama3.3 GiB on diskderived by mradermacher
hf.co/mradermacher/Granite-4.2-8B-Surgical-Abliterated-i1-GGUF:Q4_0Q4_0ollama4.7 GiB on diskderived by mradermacher
hf.co/mradermacher/Granite-4.2-8B-Surgical-Abliterated-i1-GGUF:Q4_K_MQ4_K_Mollama5.0 GiB on diskderived by mradermacher
granite-4.2-8b-i1-GGUF
hf.co/mradermacher/granite-4.2-8b-i1-GGUF:IQ1_SIQ1_Sollama2.0 GiB on diskderived by mradermacher
hf.co/mradermacher/granite-4.2-8b-i1-GGUF:IQ2_XXSIQ2_XXSollama2.4 GiB on diskderived by mradermacher
hf.co/mradermacher/granite-4.2-8b-i1-GGUF:IQ3_XXSIQ3_XXSollama3.3 GiB on diskderived by mradermacher
hf.co/mradermacher/granite-4.2-8b-i1-GGUF:Q4_0Q4_0ollama4.7 GiB on diskderived by mradermacher
hf.co/mradermacher/granite-4.2-8b-i1-GGUF:Q4_K_MQ4_K_Mollama5.0 GiB on diskderived by mradermacher
granite-4.2-8b-heretic
saidutta69/granite-4.2-8b-hereticBF16vllm16.4 GiB on diskderived by saidutta69
ask your own gram

Your concierge can answer this from the network rather than from this page. The ask carries the operator id, so it resolves to a capability and an engine — not to a name somebody has to recognise.

What has this network measured about the Granite 4.2 family (epn.family.granite-4-2), and can my gram run any of it? See /inferences/granite-4-2

open a gramx with this ask →epn.family.granite-4-2