6 builds of functiongemma-270m-it-GGUF measured on real machines — different packagers, precisions and engines, each a different file with its own numbers. The best each engine proved is first; every build has its own page with the machines and signatures behind it.
proved by at least one build: Structured output
| build | publisher | precision | engine | whose work | context proved | best tok/s | machines |
|---|---|---|---|---|---|---|---|
| hf.co/Mungert/functiongemma-270m-it-GGUF:IQ4_NL | Mungert | IQ4_NL | ollama | derivative | — | 40.2 | 1 |
| hf.co/Mungert/functiongemma-270m-it-GGUF:Q3_K_S | Mungert | Q3_K_S | ollama | derivative | — | 34.4 | 1 |
| hf.co/Mungert/functiongemma-270m-it-GGUF:Q4_1 | Mungert | Q4_1 | ollama | derivative | — | 33.5 | 1 |
| hf.co/Mungert/functiongemma-270m-it-GGUF:Q4_K_M | Mungert | Q4_K_M | ollama | derivative | — | 32.8 | 1 |
| hf.co/Mungert/functiongemma-270m-it-GGUF:Q8_0 | Mungert | Q8_0 | ollama | derivative | — | 22.3 | 1 |
| hf.co/Mungert/functiongemma-270m-it-GGUF:BF16 | Mungert | BF16 | ollama | derivative | — | 20.1 | 1 |