Language Models are Few-Shot Learners (GPT-3)PDF Download

The GPT-3 paper studies whether a sufficiently large language model can perform tasks from instructions and examples in its context, without task-specific parameter updates. It compares several prompting settings.

The examples make the change in interaction style easy to see. Read the uneven results and limitations too: a compelling completion is not the same as reliable performance across tasks.