LSTM is dead. Long Live Transformers!

Why it was recommended

has gotten tons of compliments and keeps people watching year after year

Strong recommendationleopd · Original2023-05

What it covers

Leo Dirac explains how transformer models have replaced LSTMs in NLP. He gives background from bag of words through RNNs and LSTMs, then a technical deep dive into. It is for someone who already knows the basic terms and wants the next step.

Video details

Channel

Seattle Applied Deep Learning

Length

28 min 48 sec

Year

2019

More in this topic

• Transformers, the tech behind LLMs | Deep Learning Chapter 5
• Deep Dive into LLMs like ChatGPT
• Let's build GPT: from scratch, in code, spelled out.
• A Hackers' Guide to Language Models
• [1hr Talk] Intro to Large Language Models
• Sparks of AGI: early experiments with GPT-4