Deep Dive into LLMs like ChatGPT

Why it was recommended

I highly recommend Andrej Karpathy's Deep Dive into LLMs like ChatGPT

Strong recommendationromanhn · Original2026-02

What it covers

Andrej Karpathy's three-hour-plus general-audience deep dive into how ChatGPT-style LLMs are built, covering the full training stack from pretraining to post-training. It also gives mental. It is for someone meeting the subject for the first time.

Video details

Channel

Andrej Karpathy

Length

3 hr 31 min

Year

2025

More in this topic

• Transformers, the tech behind LLMs | Deep Learning Chapter 5
• Let's build GPT: from scratch, in code, spelled out.
• A Hackers' Guide to Language Models
• [1hr Talk] Intro to Large Language Models
• Sparks of AGI: early experiments with GPT-4
• Let's build the GPT Tokenizer