But what is cross-entropy? | Compression is Intelligence Part 2

3Blue1Brown · 33:51

742,626 views · 21,012 likes · Jul 16, 2026

Where the loss function for training LLMs comes from.
Job opportunities aligned to this audience: https://3b1b.co/talent
Early views and other perks for supporters: https://3b1b.co/support
Home page: https://www.3blue1brown.com

Part 1: https://youtu.be/l6DKRf-fAAM

If you want to learn more about Lagrange Multipliers, I made multiple videos and articles for the topic back in my Khan Academy days:…

Where the loss function for training LLMs comes from.
Job opportunities aligned to this audience: https://3b1b.co/talent
Early views and other perks for supporters: https://3b1b.co/support
Home page: https://www.3blue1brown.com

Part 1: https://youtu.be/l6DKRf-fAAM

If you want to learn more about Lagrange Multipliers, I made multiple videos and articles for the topic back in my Khan Academy days:…

Watch this and more from 3Blue1Brown on Playtoob — no recommendations, no algorithm, just the channels you choose.