Model

olmoe

1 entry · 4 September 2024

Appears alongside

Featured in threads

Tracks

  • Open weights & ecosystem 1
  • Models & capabilities 1

  1. AI2 releases OLMoE mixture-of-experts model

    1 billion active of 7 billion total parameters, trained on 5 trillion tokens, released with 244 intermediate checkpoints and full training data and logs.

    Allen Institute for AIOpen weights & ecosystem · Models & capabilities

In the commentary

Pieces from around the web that discuss olmoe. External links.