CS480/680 Lecture 19: Attention and Transformer Networks

Why it was recommended

I would also recommend Pascal Poupart's talk [1] on Attention and Transformers.

Recommendationabhgh · Original2023-04

What it covers

A university lecture from CS480/680 by Pascal Poupart on attention mechanisms and transformer networks, worked through on a chalkboard. It is for someone who already knows the basic terms and wants the next step.

Video details

Channel

Pascal Poupart

Length

1 hr 22 min

Year

2019

More in this topic

• Transformers, the tech behind LLMs | Deep Learning Chapter 5
• Deep Dive into LLMs like ChatGPT
• Let's build GPT: from scratch, in code, spelled out.
• A Hackers' Guide to Language Models
• [1hr Talk] Intro to Large Language Models
• Sparks of AGI: early experiments with GPT-4