Business2 sources
Hugging Face now routes model requests through OpenRouter for the best price or speed
The Decoder · By Jonathan Kemper ·
The Brief · written from 2 sources
- Hugging Face now routes language model inference requests through OpenRouter, which selects the cheapest or fastest provider.
- Bring-your-own API keys for language models are being discontinued.
- According to OpenRouter, the new routing cut capacity errors by 46 percent.
Why it matters
Developers using Hugging Face for language model inference will have requests served by OpenRouter's provider routing, and they can no longer use their own API keys for these models.
Who’s affected
- Developers using Hugging Face language model inference
- Teams relying on bring-your-own API keys for language models on Hugging Face
What to do
- Check whether your integration uses your own provider API keys for language models, since that option is going away.
- #inference
- #hugging-face
- #openrouter
- #llm-routing
- #api
Hugging Face now routes language model requests through OpenRouter, which automatically selects the cheapest or fastest provider. Bring-your-own API keys for language models are going away. According to OpenRouter, the new routing cut capacity errors by 46 percent. Both partners…
Timeline
Full coverage · 2 sources
- 1h ago ↗
The Decoder
Hugging Face now routes model requests through OpenRouter for the best price or speed
- 2h ago ↗
The New Stack
“Collaboration over competition”: Hugging Face hands model inference traffic to OpenRouter