of Llama 3.3 70B Instruct's tool calls fail on AkashML (fp8).
Not all models are served equally by all providers. On a typical model, the worst provider breaks tool calls 19× as often as the best. Find the best one for your agents.
| # | Provider | Broken tool calls | Tool calls a day | $ in / out per M | Tokens/s | Uptime |
|---|---|---|---|---|---|---|
| 1 | Groq# | 2.21% | 2.5k | $0.59 / $0.79 | 223 | 100.0% |
| 2 | CoreWeavefp16# | 4.65% | 54k | $0.71 / $0.71 | 87 | 100.0% |
| 3 | DeepInfrafp8/turbo# | 9.94% | 6.5k | $0.10 / $0.32 | 19 | 99.2% |
| 4 | NovitaAIbf16# | 25.58% | 2.4k | $0.14 / $0.40 | 35 | 98.8% |
| 5 | AkashMLfp8# | 32.75% | 9.0k | $0.20 / $0.52 | 33 | 100.0% |
{
"provider": {
"order": [
"groq"
],
"ignore": [
"coreweave/fp16",
"deepinfra/turbo",
"novita/bf16",
"akashml/fp8"
]
}
}Point your agent at llms.txt
And which provider to use.
Releasing a model? Test it before launch.
of Llama 3.3 70B Instruct's tool calls fail on AkashML (fp8).
as often on AkashML (fp8) as on Groq, its best provider.
broken tool calls a day across its 5 providers.