Attention Is All You Need

Why it was recommended

The Yannic kilcher review is quite good.

Recommendationthrowawaymaths · Original2023-05

What it covers

Yannic Kilcher walks through the Attention Is All You Need paper, which introduced the Transformer, a sequence model based solely on attention without recurrence or. It is for someone who already knows the basic terms and wants the next step.

Video details

Channel

Yannic Kilcher

Length

27 min 7 sec

Year

2017

More in this topic

• Transformers, the tech behind LLMs | Deep Learning Chapter 5
• Deep Dive into LLMs like ChatGPT
• Let's build GPT: from scratch, in code, spelled out.
• A Hackers' Guide to Language Models
• [1hr Talk] Intro to Large Language Models
• Sparks of AGI: early experiments with GPT-4