family member

FunctionGemma 270M

7 builds of FunctionGemma 270M measured on real machines — different packagers, precisions and engines, each a different file with its own numbers. The best each engine proved is first; every build has its own page with the machines and signatures behind it.

on ollama · 7 builds

no context proved on this engine yet

37.2 tok/s peak, by unsloth Q4_0

proved by at least one build: Structured output · Sustained output · Reasons about code

build	publisher	precision	engine	whose work	context proved	best tok/s	machines
hf.co/unsloth/functiongemma-270m-it-GGUF:Q4_0	unsloth	Q4_0	ollama	quantizer	—	37.2	1
hf.co/unsloth/functiongemma-270m-it-GGUF:Q4_K_M	unsloth	Q4_K_M	ollama	quantizer	—	33.8	1
hf.co/unsloth/functiongemma-270m-it-GGUF:IQ2_XXS	unsloth	IQ2_XXS	ollama	quantizer	—	33.1	1
hf.co/unsloth/functiongemma-270m-it-GGUF:Q8_0	unsloth	Q8_0	ollama	quantizer	—	32.9	1
hf.co/unsloth/functiongemma-270m-it-GGUF:IQ3_XXS	unsloth	IQ3_XXS	ollama	quantizer	—	32.6	1
hf.co/unsloth/functiongemma-270m-it-GGUF:IQ2_M	unsloth	IQ2_M	ollama	quantizer	—	32.5	1
hf.co/unsloth/functiongemma-270m-it-GGUF:BF16	unsloth	BF16	ollama	quantizer	—	18.7	1

derivatives — somebody else's change to these weights

Fine-tunes, merges and abliterations of this member, each its own model with its own page. None of their numbers are counted above.