Two tweets I think about a lot

the porous city

Humans don't need to learn from 1 trillion words to reach human intelligence.
What are LLMs missing? https://t.co/JysSIvegX4
— Yann LeCun (@ylecun) March 28, 2023

and

The amount of information to transform chimpanzee DNA into human DNA is about 8 megabytes.
It took about 5 million years.
So we are talking 12 bits per year.
Not much.
— Yann LeCun (@ylecun) March 28, 2023