Humans don't need to learn from 1 trillion words to reach human intelligence.
— Yann LeCun (@ylecun) March 28, 2023
What are LLMs missing? https://t.co/JysSIvegX4
The amount of information to transform chimpanzee DNA into human DNA is about 8 megabytes.
— Yann LeCun (@ylecun) March 28, 2023
It took about 5 million years.
So we are talking 12 bits per year.
Not much.
This is Lukas Bergstrom's weblog. You can also find me on Twitter and LinkedIn.
Tech
Social, PIM, barcamp, Audio, a11y, Android, Energy, OS, Security, s60, Shopping, AI, MacOS, Web analytics, Open, Collaboration, Mobile, Hardware, Storage, Automobile, Net, Wearables, Crowdsourcing, Javascript, Data, Web, Visual, Development, Product Management, Business, Medical, RSS, WRX
Other
Food & Drink, Travel, Berlin, Clothes, Minnesota, Quizzes, Activism, L.A., History, Life hacks, Agriculture, Podcasts, Politik, California, Personal care, Housing, Video, Feminism, CrowdFlower, Surfing, Geography, Transportation, San Francisco, Games, Boston, Toys, Statistics, Friday, Sports, Law, Bicycling, NYC
Music
Good tracks, Shopping, Streams, Boston, Business, Mixes, Mp3s, House, Making, Events, Musicians, Mailing lists, Booking, Hip-hop, Labels, L.A., History, Reviews, Videos, Lyrics
People
Stories, Me, Gossip, Subcultures, Heroes, Meditation, Health, Languages, Friends, Exercise, Buddhism, Family, ADD, Vocations, MOTAS, Enemies, Life hacks, Working with, Weblogs
Commerce
Non-profit, Taxes, Personal finance, Insurance, Shopping, Marketing and CRM, Web, Macroeconomics, Investing, International Development, Real Estate, Personal services, IP Law, Management consulting, Microfinance
Arts
Desktop wallpaper bait, Movies, Animation, Rhetoric, Events, Spoken Word, Humor, Poetry, Visual, Sculpture, Comix, Burning Man, Literature, iPad bait, Outlets
Design
Algorithmic, Process, User experience, Furniture, Cool, Data visualization, Type, IA, Web, Tools, Architecture, Presentations
Science
Networks, Zoology, Psychology, Cognition, Statistics and Data, Environment, Physics
Travel
Kingdom of Siam, Kenya, Vagabond '08, Uganda