Andrej Karpathy just broke the entire premise of modern AI:
"Agents aren't magic. They're distillation at scale."
99.99% of your LLM's capacity is wasted on garbage data it never needed.
Small model + right tools + closed loop = terrifying capability.
In a 16-minute… https://t.co/rb4JlxipF4 pic.twitter.com/0jcdQbK023 — Morty
https://x.com/0xmortyx/status/2078468804276019504?s=12