PickVidsAttention in transformers, step-by-step | Deep Learning Chapter 6
Why it was recommended
what bade me finally understand the transformer architecture [0] and attention [1], are 3Blue1Brown's videos.
Strong recommendationtomashm · Original
What it covers
3Blue1Brown's visual walkthrough of the attention mechanism inside transformers, covering self-attention, multiple heads and cross-attention. It is chapter 6 of his deep learning series. It is for someone meeting the subject for the first time.
Video details
- Channel
- 3Blue1Brown
- Length
- 26 min 10 sec
- Year
- 2024