7 builds of Gemma 3 270M measured on real machines — different packagers, precisions and engines, each a different file with its own numbers. The best each engine proved is first; every build has its own page with the machines and signatures behind it.
trained 32K · proved 32K context proved by unsloth Q8_0
37.4 tok/s peak, by unsloth Q4_K_M
proved by at least one build: Structured output · Sustained output · Writes code
| build | publisher | precision | engine | whose work | context proved | best tok/s | machines |
|---|---|---|---|---|---|---|---|
| hf.co/unsloth/gemma-3-270m-it-GGUF:Q8_0 | unsloth | Q8_0 | ollama | quantizer | 32,768 | 31.3 | 1 |
| hf.co/unsloth/gemma-3-270m-it-GGUF:F16 | unsloth | F16 | ollama | quantizer | 16,384 | 23.5 | 1 |
| hf.co/unsloth/gemma-3-270m-it-GGUF:Q4_K_M | unsloth | Q4_K_M | ollama | quantizer | — | 37.4 | 1 |
| hf.co/unsloth/gemma-3-270m-it-GGUF:IQ2_M | unsloth | IQ2_M | ollama | quantizer | — | 34.8 | 1 |
| hf.co/unsloth/gemma-3-270m-it-GGUF:IQ2_XXS | unsloth | IQ2_XXS | ollama | quantizer | — | 34.5 | 1 |
| hf.co/unsloth/gemma-3-270m-it-GGUF:IQ3_XXS | unsloth | IQ3_XXS | ollama | quantizer | — | 33.4 | 1 |
| hf.co/unsloth/gemma-3-270m-it-GGUF:Q4_0 | unsloth | Q4_0 | ollama | quantizer | — | 33.0 | 1 |