Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence

Why it was recommended

Ilya Sutskever from OpenAI saying that the data situation is good and there's more data to train on

Referencejstx1 · Original2023-04

What it covers

Dwarkesh Patel interviews OpenAI chief scientist Ilya Sutskever on time to AGI, what comes after generative models, data limits, alignment, and competing with Google. The. It is for someone who already knows the basic terms and wants the next step.

Video details

Channel

Dwarkesh Patel

Length

47 min 41 sec

Year

2023

More in this topic

• Transformers, the tech behind LLMs | Deep Learning Chapter 5
• Deep Dive into LLMs like ChatGPT
• Let's build GPT: from scratch, in code, spelled out.
• A Hackers' Guide to Language Models
• [1hr Talk] Intro to Large Language Models
• Sparks of AGI: early experiments with GPT-4