of MiMo-V2.6-Flash's tool calls fail on Relace (mxfp4).
Not all models are served equally by all providers. On a typical model, the worst provider breaks tool calls 19× as often as the best. Find the best one for your agents.
| # | Model | Broken tool calls | Rank | Best on the model | Tool calls a day |
|---|---|---|---|---|---|
| 1 | Kimi K3fp4 | 0.05% | 5 of 24 | DeepInfra (mxfp4) 0.01% | 109k |
| 2 | DeepSeek V4.1 Flash 1017 | 0.10% | 4 of 35 | Sail Research (fp4) 0.03% | 2.8M |
| 3 | DeepSeek V4.1 Flash | 0.14% | 3 of 35 | Prime Intellect 0.06% | 1.5M |
| 4 | DeepSeek V4 Flash 0731fp4 | 0.41% | 3 of 22 | Sail Research (fp4) 0.04% | 882k |
| 5 | GLM 5.3 | 0.57% | 15 of 42 | Amazon Bedrock 0.08% | 84k |
| 6 | DeepSeek V4 Flash 0423fp4 | 0.58% | 3 of 16 | Crusoe (fp8) 0.46% | 848k |
| 7 | DeepSeek V4 Pro 0813fp4 | 0.97% | 11 of 21 | Ionstream 0.04% | 33k |
| 8 | GLM 5.2 | 1.09% | 17 of 27 | Friendli 0.15% | 39k |
| 9 | DeepSeek V4 Pro 0423fp4 | 1.66% | 6 of 13 | Cloudflare 0.78% | 159k |
| 10 | GLM 5.3 Flash | 1.93% | 27 of 34 | NextBit (fp4) 0.00% | 710k |
| 11 | MiMo-V2.6-Flashmxfp4 | 4.17% | 8 of 9 | Venice (fp8) 1.41% | 211k |
And which provider to use.
The same provider can handle tool calls well on one model and struggle on the next.
of MiMo-V2.6-Flash's tool calls fail on Relace (mxfp4).
on Kimi K3, its best model.
models, where the settings tell OpenRouter to skip Relace.