Person

Leo Gao

2 entries · July 2020 – December 2020

Appears alongside

Featured in threads

Tracks

  • Open weights & ecosystem 2
  • Ideas & essays 1

  1. EleutherAI releases The Pile

    The 825GiB corpus combined 22 curated sources rather than raw web scrapes, and models trained on it outperformed Common Crawl-only baselines on academic text.

    Open weights & ecosystem · Ideas & essays

  2. EleutherAI forms to build open language models

    A Discord server for discussing GPT-3 became a volunteer collective aiming to train and openly release a comparable model itself.

    Open weights & ecosystem