Library

Research Library

Preprint2020

Language Models are Few-Shot Learners

Brown, Mann, Ryder, Subbiah et al. · arXiv · 2020

Abstract

Shows that scaling a language model to 175B parameters produces strong task performance from a few in-context examples alone, with no gradient updates — the case for in-context learning.

Why it matters

The GPT-3 paper — where "just give it a few examples in the prompt" became a real strategy. It reframed prompting as programming.

scalingfew shotprompting
Read the source

https://arxiv.org/abs/2005.14165