of Llama 3.3 70B Instruct's tool calls fail on Groq.
Not all models are served equally by all providers. On a typical model, the worst provider breaks tool calls 19× as often as the best. Find the best one for your agents.
| # | Model | Broken tool calls | Rank | Best on the model | Tool calls a day |
|---|---|---|---|---|---|
| 1 | gpt-oss-120b | 0.04% | 1 of 15 | — | 110k |
| 2 | MiniMax M2.7 | 0.32% | 1 of 6 | — | 2.1k |
| 3 | gpt-oss-20b | 0.33% | 2 of 7 | Darkbloom (fp8) 0.13% | 307k |
| 4 | Llama 3.1 8B Instruct | 1.00% | 1 of 2 | — | 15k |
| 5 | Llama 3.3 70B Instruct | 2.21% | 1 of 5 | — | 2.5k |
And which provider to use.
The same provider can handle tool calls well on one model and struggle on the next.
of Llama 3.3 70B Instruct's tool calls fail on Groq.
on gpt-oss-120b, its best model.
models, where Groq is the most reliable provider.