Our paper on formal and functional competence in language models is now out in Trends in Cognitive Science! With co-lead @neuranna along with @IbanDlank, @Nancy_Kanwisher, Josh Tenenbaum and @ev_fedorenko. Paper: mahowak.github.io/assets/pdf/mah… Thread below. 1/n
1
59
186
36K
81
Download Image
LMs ability to produce fluent English (and other langs with big corpora) has changed a lot. The below 2011 RNN used to be impressive, with the paper patting itself on the back as providing a “surprisingly good language model” in which the “text is mostly grammatical”.