model family

Qwen 3

Published by Qwen. 14 members have been measured on real machines. Every number below was signed by the machine that produced it — none of it is from a model card.

what it takes, what it returns
text → text

Declared by the network’s catalog, not measured — a signature says what this family would be asked. Whether it answered is the signed capability flags on each member.

14 of 57 builds measured · 43 still open
what each build proved
8b · Q2_K
4b · Q4_0
4b · IQ3_XXS
4b · Q4_1 · unsloth
0.6b · Q4_K_M
4b · Q4_K_M
4b · IQ4_XS
0.6b · Q2_K
0.6b · Q3_K_M
0.6b · Q5_K_M
4b · IQ1_S
4b · Q4_1 · unsloth
4b · Q2_K
0.6b
8b · Q2_K · Tool calling — proved8b · Q2_K · Tool loop finished — proved8b · Q2_K · Faithful to tool results — asked, failed8b · Q2_K · Chained tool calls — never asked8b · Q2_K · Structured output — proved8b · Q2_K · Sustained output — proved8b · Q2_K · Extended thinking — asked, failed8b · Q2_K · Vision — proved8b · Q2_K · Counts in images — proved8b · Q2_K · Spatial reasoning — proved8b · Q2_K · Writes code — proved8b · Q2_K · Reasons about code — asked, failed8b · Q2_K · Synthesises sources — asked, failed8b · Q2_K · Follows instructions — proved4b · Q4_0 · Tool calling — proved4b · Q4_0 · Tool loop finished — proved4b · Q4_0 · Faithful to tool results — proved4b · Q4_0 · Chained tool calls — asked, failed4b · Q4_0 · Structured output — proved4b · Q4_0 · Sustained output — proved4b · Q4_0 · Extended thinking — asked, failed4b · Q4_0 · Vision — proved4b · Q4_0 · Counts in images — proved4b · Q4_0 · Spatial reasoning — proved4b · Q4_0 · Writes code — proved4b · Q4_0 · Reasons about code — asked, failed4b · Q4_0 · Synthesises sources — asked, failed4b · Q4_0 · Follows instructions — proved4b · IQ3_XXS · Tool calling — proved4b · IQ3_XXS · Tool loop finished — asked, failed4b · IQ3_XXS · Faithful to tool results — proved4b · IQ3_XXS · Chained tool calls — proved4b · IQ3_XXS · Structured output — proved4b · IQ3_XXS · Sustained output — proved4b · IQ3_XXS · Extended thinking — proved4b · IQ3_XXS · Vision — never asked4b · IQ3_XXS · Counts in images — never asked4b · IQ3_XXS · Spatial reasoning — never asked4b · IQ3_XXS · Writes code — proved4b · IQ3_XXS · Reasons about code — proved4b · IQ3_XXS · Synthesises sources — proved4b · IQ3_XXS · Follows instructions — proved4b · Q4_1 · unsloth · Tool calling — proved4b · Q4_1 · unsloth · Tool loop finished — proved4b · Q4_1 · unsloth · Faithful to tool results — proved4b · Q4_1 · unsloth · Chained tool calls — asked, failed4b · Q4_1 · unsloth · Structured output — proved4b · Q4_1 · unsloth · Sustained output — proved4b · Q4_1 · unsloth · Extended thinking — asked, failed4b · Q4_1 · unsloth · Vision — proved4b · Q4_1 · unsloth · Counts in images — proved4b · Q4_1 · unsloth · Spatial reasoning — proved4b · Q4_1 · unsloth · Writes code — proved4b · Q4_1 · unsloth · Reasons about code — asked, failed4b · Q4_1 · unsloth · Synthesises sources — asked, failed4b · Q4_1 · unsloth · Follows instructions — proved0.6b · Q4_K_M · Tool calling — proved0.6b · Q4_K_M · Tool loop finished — asked, failed0.6b · Q4_K_M · Faithful to tool results — proved0.6b · Q4_K_M · Chained tool calls — proved0.6b · Q4_K_M · Structured output — proved0.6b · Q4_K_M · Sustained output — proved0.6b · Q4_K_M · Extended thinking — proved0.6b · Q4_K_M · Vision — never asked0.6b · Q4_K_M · Counts in images — never asked0.6b · Q4_K_M · Spatial reasoning — never asked0.6b · Q4_K_M · Writes code — proved0.6b · Q4_K_M · Reasons about code — proved0.6b · Q4_K_M · Synthesises sources — proved0.6b · Q4_K_M · Follows instructions — proved4b · Q4_K_M · Tool calling — proved4b · Q4_K_M · Tool loop finished — proved4b · Q4_K_M · Faithful to tool results — proved4b · Q4_K_M · Chained tool calls — proved4b · Q4_K_M · Structured output — proved4b · Q4_K_M · Sustained output — proved4b · Q4_K_M · Extended thinking — proved4b · Q4_K_M · Vision — never asked4b · Q4_K_M · Counts in images — never asked4b · Q4_K_M · Spatial reasoning — never asked4b · Q4_K_M · Writes code — proved4b · Q4_K_M · Reasons about code — proved4b · Q4_K_M · Synthesises sources — proved4b · Q4_K_M · Follows instructions — proved4b · IQ4_XS · Tool calling — proved4b · IQ4_XS · Tool loop finished — asked, failed4b · IQ4_XS · Faithful to tool results — proved4b · IQ4_XS · Chained tool calls — asked, failed4b · IQ4_XS · Structured output — proved4b · IQ4_XS · Sustained output — never asked4b · IQ4_XS · Extended thinking — asked, failed4b · IQ4_XS · Vision — proved4b · IQ4_XS · Counts in images — proved4b · IQ4_XS · Spatial reasoning — proved4b · IQ4_XS · Writes code — proved4b · IQ4_XS · Reasons about code — asked, failed4b · IQ4_XS · Synthesises sources — never asked4b · IQ4_XS · Follows instructions — proved0.6b · Q2_K · Tool calling — never asked0.6b · Q2_K · Tool loop finished — never asked0.6b · Q2_K · Faithful to tool results — never asked0.6b · Q2_K · Chained tool calls — never asked0.6b · Q2_K · Structured output — never asked0.6b · Q2_K · Sustained output — never asked0.6b · Q2_K · Extended thinking — never asked0.6b · Q2_K · Vision — never asked0.6b · Q2_K · Counts in images — never asked0.6b · Q2_K · Spatial reasoning — never asked0.6b · Q2_K · Writes code — never asked0.6b · Q2_K · Reasons about code — never asked0.6b · Q2_K · Synthesises sources — never asked0.6b · Q2_K · Follows instructions — never asked0.6b · Q3_K_M · Tool calling — proved0.6b · Q3_K_M · Tool loop finished — proved0.6b · Q3_K_M · Faithful to tool results — proved0.6b · Q3_K_M · Chained tool calls — asked, failed0.6b · Q3_K_M · Structured output — proved0.6b · Q3_K_M · Sustained output — proved0.6b · Q3_K_M · Extended thinking — proved0.6b · Q3_K_M · Vision — never asked0.6b · Q3_K_M · Counts in images — never asked0.6b · Q3_K_M · Spatial reasoning — never asked0.6b · Q3_K_M · Writes code — proved0.6b · Q3_K_M · Reasons about code — asked, failed0.6b · Q3_K_M · Synthesises sources — proved0.6b · Q3_K_M · Follows instructions — asked, failed0.6b · Q5_K_M · Tool calling — never asked0.6b · Q5_K_M · Tool loop finished — never asked0.6b · Q5_K_M · Faithful to tool results — never asked0.6b · Q5_K_M · Chained tool calls — never asked0.6b · Q5_K_M · Structured output — never asked0.6b · Q5_K_M · Sustained output — never asked0.6b · Q5_K_M · Extended thinking — never asked0.6b · Q5_K_M · Vision — never asked0.6b · Q5_K_M · Counts in images — never asked0.6b · Q5_K_M · Spatial reasoning — never asked0.6b · Q5_K_M · Writes code — never asked0.6b · Q5_K_M · Reasons about code — never asked0.6b · Q5_K_M · Synthesises sources — never asked0.6b · Q5_K_M · Follows instructions — never asked4b · IQ1_S · Tool calling — asked, failed4b · IQ1_S · Tool loop finished — never asked4b · IQ1_S · Faithful to tool results — never asked4b · IQ1_S · Chained tool calls — never asked4b · IQ1_S · Structured output — asked, failed4b · IQ1_S · Sustained output — asked, failed4b · IQ1_S · Extended thinking — asked, failed4b · IQ1_S · Vision — never asked4b · IQ1_S · Counts in images — never asked4b · IQ1_S · Spatial reasoning — never asked4b · IQ1_S · Writes code — asked, failed4b · IQ1_S · Reasons about code — asked, failed4b · IQ1_S · Synthesises sources — asked, failed4b · IQ1_S · Follows instructions — asked, failed4b · Q4_1 · unsloth · Tool calling — never asked4b · Q4_1 · unsloth · Tool loop finished — never asked4b · Q4_1 · unsloth · Faithful to tool results — never asked4b · Q4_1 · unsloth · Chained tool calls — never asked4b · Q4_1 · unsloth · Structured output — never asked4b · Q4_1 · unsloth · Sustained output — never asked4b · Q4_1 · unsloth · Extended thinking — never asked4b · Q4_1 · unsloth · Vision — never asked4b · Q4_1 · unsloth · Counts in images — never asked4b · Q4_1 · unsloth · Spatial reasoning — never asked4b · Q4_1 · unsloth · Writes code — never asked4b · Q4_1 · unsloth · Reasons about code — never asked4b · Q4_1 · unsloth · Synthesises sources — never asked4b · Q4_1 · unsloth · Follows instructions — never asked4b · Q2_K · Tool calling — proved4b · Q2_K · Tool loop finished — asked, failed4b · Q2_K · Faithful to tool results — proved4b · Q2_K · Chained tool calls — proved4b · Q2_K · Structured output — proved4b · Q2_K · Sustained output — proved4b · Q2_K · Extended thinking — asked, failed4b · Q2_K · Vision — proved4b · Q2_K · Counts in images — proved4b · Q2_K · Spatial reasoning — proved4b · Q2_K · Writes code — proved4b · Q2_K · Reasons about code — asked, failed4b · Q2_K · Synthesises sources — proved4b · Q2_K · Follows instructions — proved0.6b · Tool calling — never asked0.6b · Tool loop finished — never asked0.6b · Faithful to tool results — never asked0.6b · Chained tool calls — never asked0.6b · Structured output — never asked0.6b · Sustained output — never asked0.6b · Extended thinking — never asked0.6b · Vision — never asked0.6b · Counts in images — never asked0.6b · Spatial reasoning — never asked0.6b · Writes code — never asked0.6b · Reasons about code — never asked0.6b · Synthesises sources — never asked0.6b · Follows instructions — never asked
Tool calling
Tool loop finished
Faithful to tool results
Chained tool calls
Structured output
Sustained output
Extended thinking
Vision
Counts in images
Spatial reasoning
Writes code
Reasons about code
Synthesises sources
Follows instructions
hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:Q2_K8b · Q2_K · 3 machines
4,096recalled
—served
22.4best tok/s
22.4 tok/s · unnamed machine3.6 tok/s · x86 · CPU · Hyderabad2.3 tok/s · unnamed machine
2.3 → 22.4 tok/s across 3 machines · ×9.6 spreadunnamed machinex86 · CPU
hf.co/unsloth/Qwen3-VL-4B-Instruct-GGUF:Q4_04b · Q4_0 · 3 machines · 4.02B
4,096recalled
—served
40.9best tok/s
40.9 tok/s · unnamed machine17.3 tok/s · unnamed machine8.4 tok/s · unnamed machine
8.4 → 40.9 tok/s across 3 machines · ×4.9 spreadunnamed machine
recalled 4k⌐ declared 256k · unsignedadvertises 64× what it proved
hf.co/unsloth/Qwen3-4B-GGUF:IQ3_XXS4b · IQ3_XXS · 2 machines
4,096recalled
—served
6.3best tok/s
4.8 tok/s · unnamed machine0.2 tok/s · unnamed machine
0.2 → 4.8 tok/s across 2 machines · ×21.7 spreadunnamed machine
hf.co/unsloth/Qwen3-VL-4B-Instruct-GGUF:Q4_14b · Q4_1 · 2 machines
4,096recalled
—served
37.0best tok/s
37.0 tok/s · unnamed machine3.1 tok/s · unnamed machine
3.1 → 37.0 tok/s across 2 machines · ×11.9 spreadunnamed machine
hf.co/MaziyarPanahi/Qwen3-0.6B-GGUF:Q4_K_M0.6b · Q4_K_M · 1 machine · 752M
4,096recalled
—served
37.4best tok/s
recalled 4k⌐ declared 40k · unsignedadvertises 10× what it proved
hf.co/Qwen/Qwen3-4B-GGUF:Q4_K_M4b · Q4_K_M · 1 machine · 4.02B
4,096recalled
—served
140.7best tok/s
recalled 4k⌐ declared 40k · unsignedadvertises 10× what it proved
hf.co/unsloth/Qwen3-VL-4B-Instruct-GGUF:IQ4_XS4b · IQ4_XS · 1 machine · 4.02B
4,096recalled
—served
6.4best tok/s
recalled 4k⌐ declared 256k · unsignedadvertises 64× what it proved
hf.co/MaziyarPanahi/Qwen3-0.6B-GGUF:Q2_K0.6b · Q2_K · 1 machine
—recalled
—served
16.0best tok/s
hf.co/MaziyarPanahi/Qwen3-0.6B-GGUF:Q3_K_M0.6b · Q3_K_M · 1 machine · 752M
—recalled
—served
44.6best tok/s
hf.co/MaziyarPanahi/Qwen3-0.6B-GGUF:Q5_K_M0.6b · Q5_K_M · 1 machine
—recalled
—served
23.9best tok/s
hf.co/unsloth/Qwen3-4B-GGUF:IQ1_S4b · IQ1_S · 1 machine
—recalled
—served
24.9best tok/s
hf.co/unsloth/Qwen3-4B-GGUF:Q4_14b · Q4_1 · 1 machine
—recalled
—served
19.4best tok/s
hf.co/unsloth/Qwen3-VL-4B-Instruct-GGUF:Q2_K4b · Q2_K · 1 machine
—recalled
—served
11.9best tok/s
qwen3:0.6b0.6b · 1 machine
—recalled
—served
18.2best tok/s

Builds this network knows of

Declared, not measured — this is what the catalog says exists and what it would cost a machine to hold. Nothing here is signed, and none of it claims the build works.

how much memory does your machine have

38 of 57 builds fit a 16 GB machine — budgeting 70% of it, or 11.2 GiB, because the cache and the runtime want the rest.

  • mlx-community/Qwen3-ASR-0.6B-8bit8BITmlxderived by mlx-community
    0.9 GiB
  • hf.co/unsloth/Qwen3-4B-GGUF:IQ1_SIQ1_Sollamameasured herequantized by unsloth
    1.0 GiB
  • hf.co/Serveurperso/Qwen3-TTS-GGUF:Q4_K_MQ4_K_Mollamaquantized by Serveurperso
    1.1 GiB
  • Qwen/Qwen3-0.6BBF16vllmpublished by Qwen
    1.4 GiB
  • hf.co/unsloth/Qwen3-4B-GGUF:IQ3_XXSIQ3_XXSollamameasured herequantized by unsloth
    1.6 GiB
  • hf.co/Serveurperso/Qwen3-TTS-GGUF:Q8_0Q8_0ollamaquantized by Serveurperso
    1.9 GiB
  • hf.co/Qwen/Qwen3-4B-GGUF:Q4_K_MQ4_K_Mollamameasured herepublished by Qwen
    2.3 GiB
  • hf.co/AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF:Q4_K_MQ4_K_Mollamaderived by AnkitAI
    2.3 GiB
  • hf.co/Qwen/Qwen3-4B-GGUF:Q5_0Q5_0ollamapublished by Qwen
    2.6 GiB
  • hf.co/Qwen/Qwen3-4B-GGUF:Q5_K_MQ5_K_Mollamapublished by Qwen
    2.7 GiB
  • hf.co/AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF:Q5_K_MQ5_K_Mollamaderived by AnkitAI
    2.7 GiB
  • lmstudio-community/Qwen3-VL-4B-Instruct-MLX-4bit4BITmlxquantized by lmstudio-community
    2.9 GiB
  • hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:Q2_KQ2_Kollamameasured herederived by mradermacher
    3.1 GiB
  • hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:Q3_K_SQ3_K_Sollamaderived by mradermacher
    3.5 GiB
  • hf.co/Serveurperso/Qwen3-TTS-GGUF:BF16BF16ollamaquantized by Serveurperso
    3.6 GiB
  • Qwen/Qwen3-1.7BBF16vllmpublished by Qwen
    3.8 GiB
  • hf.co/Qwen/Qwen3-4B-GGUF:Q8_0Q8_0ollamapublished by Qwen
    4.0 GiB
  • hf.co/AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF:Q8_0Q8_0ollamaderived by AnkitAI
    4.0 GiB
  • hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:Q3_K_LQ3_K_Lollamaderived by mradermacher
    4.1 GiB
  • lmstudio-community/DeepSeek-R1-0528-Qwen3-8B-MLX-4bit4BITmlxderived by lmstudio-community
    4.3 GiB
  • hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:Q4_K_SQ4_K_Sollamaderived by mradermacher
    4.5 GiB
  • hf.co/Qwen/Qwen3-8B-GGUF:Q4_K_MQ4_K_Mollamapublished by Qwen
    4.7 GiB
  • hf.co/AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF:Q4_K_MQ4_K_Mollamaderived by AnkitAI
    4.7 GiB
  • hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:Q4_K_MQ4_K_Mollamaderived by mradermacher
    4.7 GiB
  • hf.co/Qwen/Qwen3-8B-GGUF:Q5_0Q5_0ollamapublished by Qwen
    5.3 GiB
  • hf.co/Qwen/Qwen3-8B-GGUF:Q5_K_MQ5_K_Mollamapublished by Qwen
    5.4 GiB
  • hf.co/AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF:Q5_K_MQ5_K_Mollamaderived by AnkitAI
    5.4 GiB
  • lmstudio-community/Qwen3-VL-8B-Instruct-MLX-5bit5BITmlxquantized by lmstudio-community
    6.3 GiB
  • hf.co/Serveurperso/Qwen3-TTS-GGUF:F32F32ollamaquantized by Serveurperso
    7.2 GiB
  • Qwen/Qwen3-4BBF16vllmpublished by Qwen
    7.5 GiB
  • hf.co/unsloth/Qwen3-4B-GGUF:BF16BF16ollamaquantized by unsloth
    7.5 GiB
  • hf.co/AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF:F16F16ollamaderived by AnkitAI
    7.5 GiB
  • lmstudio-community/DeepSeek-R1-0528-Qwen3-8B-MLX-8bit8BITmlxderived by lmstudio-community
    8.1 GiB
  • hf.co/Qwen/Qwen3-8B-GGUF:Q8_0Q8_0ollamapublished by Qwen
    8.1 GiB
  • hf.co/AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF:Q8_0Q8_0ollamaderived by AnkitAI
    8.1 GiB
  • hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:Q8_0Q8_0ollamaderived by mradermacher
    8.1 GiB
  • hf.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF:IQ1_SIQ1_Sollamaquantized by unsloth
    8.3 GiB
  • hf.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF:IQ2_XXSIQ2_XXSollamaquantized by unsloth
    9.6 GiB
  • hf.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF:IQ3_XXSIQ3_XXSollamaquantized by unsloth
    12.0 GiB
  • Qwen/Qwen3-8BBF16vllmpublished by Qwen
    15.3 GiB
  • hf.co/AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF:F16F16ollamaderived by AnkitAI
    15.3 GiB
  • hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:F16F16ollamaderived by mradermacher
    15.3 GiB
  • hf.co/bartowski/Qwen_Qwen3-Next-80B-A3B-Thinking-GGUF:IQ1_SIQ1_Sollamaquantized by bartowski
    15.4 GiB
  • lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit4BITmlxquantized by lmstudio-community
    16.0 GiB
  • hf.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF:Q4_0Q4_0ollamaquantized by unsloth
    16.2 GiB
  • hf.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF:Q4_K_MQ4_K_Mollamaquantized by unsloth
    17.3 GiB
  • hf.co/bartowski/Qwen_Qwen3-Next-80B-A3B-Thinking-GGUF:IQ2_XXSIQ2_XXSollamaquantized by bartowski
    18.0 GiB
  • lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-5bit5BITmlxquantized by lmstudio-community
    19.5 GiB
  • hf.co/bartowski/Qwen_Qwen3-Next-80B-A3B-Thinking-GGUF:IQ3_XXSIQ3_XXSollamaquantized by bartowski
    29.5 GiB
  • lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-8bit8BITmlxquantized by lmstudio-community
    30.2 GiB
  • hf.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF:Q8_0Q8_0ollamaquantized by unsloth
    30.3 GiB
  • lmstudio-community/Qwen3-Coder-Next-MLX-4bit4BITmlxquantized by lmstudio-community
    41.8 GiB
  • hf.co/bartowski/Qwen_Qwen3-Next-80B-A3B-Thinking-GGUF:Q4_0Q4_0ollamaquantized by bartowski
    42.9 GiB
  • hf.co/bartowski/Qwen_Qwen3-Next-80B-A3B-Thinking-GGUF:Q4_K_MQ4_K_Mollamaquantized by bartowski
    45.4 GiB
  • lmstudio-community/Qwen3-Coder-Next-MLX-6bit6BITmlxquantized by lmstudio-community
    60.3 GiB
  • Qwen/Qwen3-32BBF16vllmpublished by Qwen
    61.0 GiB
  • lmstudio-community/Qwen3-Coder-Next-MLX-8bit8BITmlxquantized by lmstudio-community
    78.8 GiB

Sizes are what the catalog declares, not what a machine measured — fitting on disk is necessary and not sufficient. Nobody here has run these on your machine, and this narrows the candidates rather than certifying one.

the same builds, by member
Qwen 3 0.6B0.6B
hf.co/Serveurperso/Qwen3-TTS-GGUF:Q4_K_MQ4_K_Mollama1.1 GiB on diskquantized by Serveurperso
Qwen/Qwen3-0.6BBF16vllm1.4 GiB on diskpublished by Qwen
hf.co/Serveurperso/Qwen3-TTS-GGUF:Q8_0Q8_0ollama1.9 GiB on diskquantized by Serveurperso
hf.co/Serveurperso/Qwen3-TTS-GGUF:BF16BF16ollama3.6 GiB on diskquantized by Serveurperso
hf.co/Serveurperso/Qwen3-TTS-GGUF:F32F32ollama7.2 GiB on diskquantized by Serveurperso
Qwen 3 0.6B · mlx-community
mlx-community/Qwen3-ASR-0.6B-8bit8BITmlx959 MiB on diskderived by mlx-community
Qwen 3 1.7B
Qwen/Qwen3-1.7BBF16vllm3.8 GiB on diskpublished by Qwen
Qwen 3 30B-A3B
hf.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF:IQ1_SIQ1_Sollama8.3 GiB on diskquantized by unsloth
hf.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF:IQ2_XXSIQ2_XXSollama9.6 GiB on diskquantized by unsloth
hf.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF:IQ3_XXSIQ3_XXSollama12.0 GiB on diskquantized by unsloth
lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit4BITmlx16.0 GiB on diskquantized by lmstudio-community
hf.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF:Q4_0Q4_0ollama16.2 GiB on diskquantized by unsloth
hf.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF:Q4_K_MQ4_K_Mollama17.3 GiB on diskquantized by unsloth
lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-5bit5BITmlx19.5 GiB on diskquantized by lmstudio-community
lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-8bit8BITmlx30.2 GiB on diskquantized by lmstudio-community
hf.co/unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF:Q8_0Q8_0ollama30.3 GiB on diskquantized by unsloth
Qwen 3 32B
Qwen/Qwen3-32BBF16vllm61.0 GiB on diskpublished by Qwen
Qwen 3 4B
hf.co/unsloth/Qwen3-4B-GGUF:IQ1_SIQ1_Sollama1.0 GiB on diskquantized by unsloth
hf.co/unsloth/Qwen3-4B-GGUF:IQ3_XXSIQ3_XXSollama1.6 GiB on diskquantized by unsloth
hf.co/Qwen/Qwen3-4B-GGUF:Q4_K_MQ4_K_Mollama2.3 GiB on diskpublished by Qwen
hf.co/Qwen/Qwen3-4B-GGUF:Q5_0Q5_0ollama2.6 GiB on diskpublished by Qwen
hf.co/Qwen/Qwen3-4B-GGUF:Q5_K_MQ5_K_Mollama2.7 GiB on diskpublished by Qwen
lmstudio-community/Qwen3-VL-4B-Instruct-MLX-4bit4BITmlx2.9 GiB on diskquantized by lmstudio-community
hf.co/Qwen/Qwen3-4B-GGUF:Q8_0Q8_0ollama4.0 GiB on diskpublished by Qwen
Qwen/Qwen3-4BBF16vllm7.5 GiB on diskpublished by Qwen
hf.co/unsloth/Qwen3-4B-GGUF:BF16BF16ollama7.5 GiB on diskquantized by unsloth
Qwen 3 4B · AnkitAI
hf.co/AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF:Q4_K_MQ4_K_Mollama2.3 GiB on diskderived by AnkitAI
hf.co/AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF:Q5_K_MQ5_K_Mollama2.7 GiB on diskderived by AnkitAI
hf.co/AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF:Q8_0Q8_0ollama4.0 GiB on diskderived by AnkitAI
hf.co/AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF:F16F16ollama7.5 GiB on diskderived by AnkitAI
Qwen 3 80B-A3B
hf.co/bartowski/Qwen_Qwen3-Next-80B-A3B-Thinking-GGUF:IQ1_SIQ1_Sollama15.4 GiB on diskquantized by bartowski
hf.co/bartowski/Qwen_Qwen3-Next-80B-A3B-Thinking-GGUF:IQ2_XXSIQ2_XXSollama18.0 GiB on diskquantized by bartowski
hf.co/bartowski/Qwen_Qwen3-Next-80B-A3B-Thinking-GGUF:IQ3_XXSIQ3_XXSollama29.5 GiB on diskquantized by bartowski
hf.co/bartowski/Qwen_Qwen3-Next-80B-A3B-Thinking-GGUF:Q4_0Q4_0ollama42.9 GiB on diskquantized by bartowski
hf.co/bartowski/Qwen_Qwen3-Next-80B-A3B-Thinking-GGUF:Q4_K_MQ4_K_Mollama45.4 GiB on diskquantized by bartowski
Qwen 3 8B
hf.co/Qwen/Qwen3-8B-GGUF:Q4_K_MQ4_K_Mollama4.7 GiB on diskpublished by Qwen
hf.co/Qwen/Qwen3-8B-GGUF:Q5_0Q5_0ollama5.3 GiB on diskpublished by Qwen
hf.co/Qwen/Qwen3-8B-GGUF:Q5_K_MQ5_K_Mollama5.4 GiB on diskpublished by Qwen
lmstudio-community/Qwen3-VL-8B-Instruct-MLX-5bit5BITmlx6.3 GiB on diskquantized by lmstudio-community
hf.co/Qwen/Qwen3-8B-GGUF:Q8_0Q8_0ollama8.1 GiB on diskpublished by Qwen
Qwen/Qwen3-8BBF16vllm15.3 GiB on diskpublished by Qwen
Qwen 3 8B · AnkitAI
hf.co/AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF:Q4_K_MQ4_K_Mollama4.7 GiB on diskderived by AnkitAI
hf.co/AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF:Q5_K_MQ5_K_Mollama5.4 GiB on diskderived by AnkitAI
hf.co/AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF:Q8_0Q8_0ollama8.1 GiB on diskderived by AnkitAI
hf.co/AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF:F16F16ollama15.3 GiB on diskderived by AnkitAI
Qwen 3 8B · lmstudio-community
lmstudio-community/DeepSeek-R1-0528-Qwen3-8B-MLX-4bit4BITmlx4.3 GiB on diskderived by lmstudio-community
lmstudio-community/DeepSeek-R1-0528-Qwen3-8B-MLX-8bit8BITmlx8.1 GiB on diskderived by lmstudio-community
Qwen 3 8B · mradermacher
hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:Q2_KQ2_Kollama3.1 GiB on diskderived by mradermacher
hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:Q3_K_SQ3_K_Sollama3.5 GiB on diskderived by mradermacher
hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:Q3_K_LQ3_K_Lollama4.1 GiB on diskderived by mradermacher
hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:Q4_K_SQ4_K_Sollama4.5 GiB on diskderived by mradermacher
hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:Q4_K_MQ4_K_Mollama4.7 GiB on diskderived by mradermacher
hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:Q8_0Q8_0ollama8.1 GiB on diskderived by mradermacher
hf.co/mradermacher/Qwen3-VL-8B-Instruct-abliterated-GGUF:F16F16ollama15.3 GiB on diskderived by mradermacher
Qwen 3 CODER-NEXT
lmstudio-community/Qwen3-Coder-Next-MLX-4bit4BITmlx41.8 GiB on diskquantized by lmstudio-community
lmstudio-community/Qwen3-Coder-Next-MLX-6bit6BITmlx60.3 GiB on diskquantized by lmstudio-community
lmstudio-community/Qwen3-Coder-Next-MLX-8bit8BITmlx78.8 GiB on diskquantized by lmstudio-community
ask your own gram

Your concierge can answer this from the network rather than from this page. The ask carries the operator id, so it resolves to a capability and an engine — not to a name somebody has to recognise.

What has this network measured about the Qwen 3 family (epn.family.qwen-3), and can my gram run any of it? See /inferences/qwen-3

open a gramx with this ask →epn.family.qwen-3