GPT3: An Even Bigger Language Model - Computerphile

Why it was recommended

Computerphile summed it up pretty well on GPT-3's release

ReferenceCSMastermind · Original2023-01

What it covers

Rob Miles discusses GPT-3 on Computerphile, covering how scaling parameters kept improving results over GPT-2 and how the model nearly learned arithmetic without anyone. It is for a general viewer who does not plan to take a prerequisite first.

Video details

Channel

Computerphile

Length

25 min 57 sec

Year

2020

More in this topic

• Transformers, the tech behind LLMs | Deep Learning Chapter 5
• Deep Dive into LLMs like ChatGPT
• Let's build GPT: from scratch, in code, spelled out.
• A Hackers' Guide to Language Models
• [1hr Talk] Intro to Large Language Models
• Sparks of AGI: early experiments with GPT-4