Inference · hardware
What each kind of machine does.
Every kind of machine that has signed a result here — by its card, or its CPU when it has none — with the fastest model it runs, the cheapest million tokens, and its parts as the machines benchmarked them. Same signed results as the provider standings, grouped by machine instead of by person.
14kinds of machine
17machines
11with a card
- Every number signed by the machine that measured it — check any one in your browser
- Open data: table.json · built 2026-10-28 23:12 UTC
- Every version, in git history
- How it is measured
| Machine | Machines · owners | Signed runs | Fastest model | Cheapest per M | Cardfp16 TFLOP/s, median | MemoryGB/s, median |
|---|---|---|---|---|---|---|
 Tesla T4·a5be46·e78fd2 | 2 · 2 | 92 | Qwen2.5 0.5B Instruct239 tok/s | $0.56Qwen2.5 0.5B Instruct | — | — |
| NVIDIA GeForce RTX 3080 Ti·84bf54 | 1 · 1 | 40 | Llama 3.2 3B225 tok/s | $1.14Llama 3.2 3B | 56.1 | 17.7 |
| 2× Tesla T4·e61d3b | 1 · 1 | 78 | Hunyuan MT 1.5 1.8B132 tok/s | $1.03Hunyuan MT 1.5 1.8B | 11.5 | 3.4 |
 Apple M4·afbb8a | 1 · 1 | 42 | Sarvam-162 tok/s | $3.16Sarvam-1 | — | — |
 Intel(R) UHD Graphics 730·9e3c79 | 1 · 1 | 63 | Gemma 3 270M52 tok/s | $1.38Gemma 3 270M | — | 3.6 |
| NVIDIA GeForce RTX 3050 Laptop GPU·53b229 | 1 · 1 | 4 | Phi 4 Mini-Reasoning42 tok/s | $5.19Phi 4 Mini-Reasoning | — | — |
| Linux, CPU only · 4 CPUs·acbe75·e3654f | 2 · 2 | 85 | FunctionGemma 270M40 tok/s | $0.76FunctionGemma 270M | — | 2.5 |
 AMD Radeon(TM) Vega 8 Mobile Graphics·d061c9 | 1 · 1 | 17 | Gemma 3 270M27 tok/s | $6.41Gemma 3 270M | — | 2.7 |
| NVIDIA GeForce GTX 1650·12954d | 1 · 1 | 3 | Sarvam-123 tok/s | $7.51Sarvam-1 | — | — |
| Apple M1·0548a8·0c5265 | 2 · 2 | 17 | Llama 3.2 1B20 tok/s | $8.60Llama 3.2 1B | — | — |
| Windows, CPU only · 12 CPUs·9a1db0 | 1 · 1 | 7 | Gemma 4 E2B15 tok/s | $14Gemma 4 E2B | — | — |
| Intel(R) Iris(R) Xe Graphics·2e5c02 | 1 · 1 | 7 | Qwen2.5 0.5B Instruct11 tok/s | $6.75Qwen2.5 0.5B Instruct | — | — |
| apple·d68672 | 1 · 1 | 21 | Llama 3.2 1B5 tok/s | $6.56Llama 3.2 1B | — | 0.1 |
| Linux, CPU only · ? CPUs·15d9e9 | 1 · 1 | 3 | — | — | — | — |
Ranked by the fastest signed result. A dash is a part no machine of that kind has benchmarked and signed yet. Prices are the network's metered rates on each machine.