1 build of Krutrim-2 Instruct measured on real machines — different packagers, precisions and engines, each a different file with its own numbers. The best each engine proved is first; every build has its own page with the machines and signatures behind it. 12B parameters, as the vendor states.
trained 1000K · proved 64K context proved by bartowski Q4_K_M
13.6 tok/s peak, by bartowski Q4_K_M
proved by at least one build: Structured output · Sustained output · Writes code · Synthesises sources · Follows instructions
| build | publisher | precision | engine | whose work | context proved | best tok/s | machines |
|---|---|---|---|---|---|---|---|
| hf.co/bartowski/krutrim-ai-labs_Krutrim-2-instruct-GGUF:Q4_K_M | bartowski | Q4_K_M | ollama | quantizer | 65,536 | 13.6 | 2 |