Model

mamba

1 entry · 1 December 2023

Appears alongside

Tracks

  • Ideas & essays 1

  1. Mamba paper proposes selective state-space models as a transformer alternative

    Letting the model's internal state-update rules depend on the input let a 3-billion-parameter Mamba match transformers twice its size while running five times faster.

    Ideas & essays

In the commentary

Pieces from around the web that discuss mamba. External links.