1 build of Airavata 7B (Hindi) measured on real machines — different packagers, precisions and engines, each a different file with its own numbers. The best each engine proved is first; every build has its own page with the machines and signatures behind it. 7B parameters, as the vendor states.
proved by at least one build: Sustained output · Follows instructions
| build | publisher | precision | engine | whose work | context proved | best tok/s | machines |
|---|---|---|---|---|---|---|---|
| hf.co/mradermacher/Airavata-GGUF:Q4_K_M | mradermacher | Q4_K_M | ollama | quantizer | — | 31.8 | 1 |