of gpt-oss-20b's tool calls fail on Darkbloom (fp8).
Not all models are served equally by all providers. On a typical model, the worst provider breaks tool calls 19× as often as the best. Find the best one for your agents.
| # | Model | Broken tool calls | Rank | Best on the model | Tool calls a day |
|---|---|---|---|---|---|
| 1 | Gemma 4 26B A4B | 0.00% | 2 of 11 | NextBit (bf16) 0.00% | 16k |
| 2 | Nemotron 3.5 Lightningint4 | 0.01% | 1 of 4 | — | 3.9k |
| 3 | Qwen3.8 27Bfp4 | 0.07% | 1 of 21 | — | 3.9k |
| 4 | Qwen3.5-9Bfp4 | 0.08% | 1 of 5 | — | 35k |
| 5 | gpt-oss-20bfp8 | 0.13% | 1 of 7 | — | 20k |
And which provider to use.
The same provider can handle tool calls well on one model and struggle on the next.
of gpt-oss-20b's tool calls fail on Darkbloom (fp8).
on Gemma 4 26B A4B, its best model.
models, where Darkbloom is the most reliable provider.