Release
Baidu releases ERNIE 5.5 Flash Base with 280 billion parameters as an open-source foundation model
The Decoder · By Matthias Bastian ·
The Brief
- Baidu released ERNIE 5.5 Flash Base as an open-source foundation model.
- The model is a 280-billion-parameter MoE model pre-trained on 33.5 trillion tokens.
- It is shipped without fine-tuning, so developers can adapt it for their own purposes.
Why it matters
Developers get a large open-source base model that they can fine-tune and deploy without the constraints of a fine-tuned or hosted release.
Who’s affected
- Developers and teams looking for open-source foundation models to fine-tune
- ERNIE 5.5 Flash Base
- #open-source
- #llm
- #foundation-model
- #baidu
- #moe
- #ernie
Baidu releases ERNIE 5.5 Flash Base: a 280-billion-parameter MoE model pre-trained on 33.5 trillion tokens, shipped deliberately without fine-tuning, so developers can take it wherever they want. The article Baidu releases ERNIE 5.5 Flash Base with 280 billion parameters as an…
Timeline
Baidu releases ERNIE 5.5 Flash Base as an open-source base model
The Decoder
Baidu releases ERNIE 5.5 Flash Base with 280 billion parameters as an open-source foundation model