Model

turing-nlg

1 entry · 13 February 2020

Appears alongside

Featured in threads

Tracks

  • Models & capabilities 1

  1. Microsoft announces Turing-NLG at 17 billion parameters

    Briefly the largest published language model, trained with Microsoft's new DeepSpeed library and beating Megatron-LM on WikiText-103 and LAMBADA.

    Models & capabilities