'Are Emergent Abilities of Large Language Models a Mirage?' challenges emergence claims
Reanalysing the same benchmark results with linear metrics, the Stanford authors made the apparent phase transitions disappear; the paper won a NeurIPS 2023 outstanding paper award.
Ideas & essays · Benchmarks & progress