0 citations
Emergent Abilities of Large Language Models
arXiv (Cornell University)2022
Citations Over Time
Jason Lee, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H., Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, William Fedus
Abstract
Scaling up language models has been shown to predictably improve performance and sample efficiency on a wide range of downstream tasks. This paper instead discusses an unpredictable phenomenon that we refer to as emergent abilities of large language models. We consider an ability to be emergent if it is not present in smaller models but is present in larger models. Thus, emergent abilities cannot be predicted simply by extrapolating the performance of smaller models. The existence of such emergence implies that additional scaling could further expand the range of capabilities of language models.
Related Papers
- → Impostor Phenomenon: an Overview of Foreign Studies(2023)2 cited
- Research of the tiny corporations' cluster phenomenon——Analysis of the specific clusters phenomenon of Wenzhou(2003)
- Yao ming phenomenon analyzed from the perspective of socio-cultural(2006)
- → PROFESSIONAL PEDAGOGICAL PHENOMENON AS AN OBJECT OF RESEARCH(2003)
- → The Phenomenon of “Coupvolution” in Africa(2023)