Discussion on "AI Paper Review: Language Models are Few-Shot Learners (GPT-3)". After GPT-2, it became clear that language models could do much more than researchers originally expected. Simply training a model to predict the next word had already started producing surprising abi