of Kimi K2.6's tool calls fail on Chutes (int4).
Not all models are served equally by all providers. On a typical model, the worst provider breaks tool calls 19× as often as the best. Find the best one for your agents.
| # | Model | Broken tool calls | Rank | Best on the model | Tool calls a day |
|---|---|---|---|---|---|
| 1 | GLM 5.1fp8 | 0.87% | 3 of 7 | Friendli 0.00% | 2.4k |
| 2 | Qwen3.8 27Bfp8 | 1.00% | 11 of 21 | Darkbloom (fp4) 0.07% | 245k |
| 3 | Gemma 4 31Bfp4 | 1.34% | 5 of 12 | ModelRun [by Modular] (fp4) 0.09% | 15k |
| 4 | Kimi K2.6int4 | 2.07% | 13 of 14 | SiliconFlow (fp8) 0.06% | 4.5k |
And which provider to use.
The same provider can handle tool calls well on one model and struggle on the next.
of Kimi K2.6's tool calls fail on Chutes (int4).
on GLM 5.1, its best model.
models, where Chutes is the most reliable provider.