of Gemma 4 31B's tool calls fail on Friendli.
Not all models are served equally by all providers. On a typical model, the worst provider breaks tool calls 19× as often as the best. Find the best one for your agents.
| # | Model | Broken tool calls | Rank | Best on the model | Tool calls a day |
|---|---|---|---|---|---|
| 1 | GLM 5.1 | 0.00% | 1 of 7 | — | 1.3k |
| 2 | GLM 5.3 | 0.08% | 2 of 42 | Amazon Bedrock 0.08% | 3.4k |
| 3 | GLM 5.3 Flash | 0.10% | 2 of 34 | NextBit (fp4) 0.00% | 268k |
| 4 | GLM 5.2 | 0.15% | 1 of 27 | — | 12k |
| 5 | Gemma 4 31B | 0.80% | 2 of 12 | ModelRun [by Modular] (fp4) 0.09% | 8.6k |
And which provider to use.
The same provider can handle tool calls well on one model and struggle on the next.
of Gemma 4 31B's tool calls fail on Friendli.
on GLM 5.1, its best model.
models, where Friendli is the most reliable provider.