PickVidsThe spelled-out intro to language modeling: building makemore
Why it was recommended
It's long (2h), but well worth the time if anyone is curious about the technical workings of LLMs.
Strong recommendationislewis · Original
What it covers
Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward. It is for someone meeting the subject for the first time.
Video details
- Channel
- Andrej Karpathy
- Length
- 1 hr 57 min
- Year
- 2022
More in this topic
- The spelled-out intro to neural networks and backpropagation: building micrograd
- But what is a neural network? | Deep learning chapter 1
- AlphaGo - The Movie | Full award-winning documentary
- Transformers, the tech behind LLMs | Deep Learning Chapter 5
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible?
- Lecture 1 | Machine Learning (Stanford)