of DeepSeek V4.1 Flash 1017's tool calls fail on Decart (fp4).
Not all models are served equally by all providers. On a typical model, the worst provider breaks tool calls 19× as often as the best. Find the best one for your agents.
| # | Model | Broken tool calls | Rank | Best on the model | Tool calls a day |
|---|---|---|---|---|---|
| 1 | DeepSeek V4.1 Flashfp4 | 0.34% | 10 of 35 | Prime Intellect 0.06% | 407k |
| 2 | GLM 5.3fp4 | 0.38% | 11 of 42 | Amazon Bedrock 0.08% | 185k |
| 3 | GLM 5.2fp4/fast | 0.45% | 7 of 27 | Friendli 0.15% | 63k |
| 4 | Kimi K3mxfp4 | 0.45% | 22 of 24 | DeepInfra (mxfp4) 0.01% | 57k |
| 5 | DeepSeek V4.1 Flash 1017fp4 | 1.47% | 26 of 35 | Sail Research (fp4) 0.03% | 314k |
And which provider to use.
The same provider can handle tool calls well on one model and struggle on the next.
of DeepSeek V4.1 Flash 1017's tool calls fail on Decart (fp4).
on DeepSeek V4.1 Flash, its best model.
models, where Decart is the most reliable provider.