Humans don't need to learn from 1 trillion words to reach human intelligence.
— Yann LeCun (@ylecun) March 28, 2023
What are LLMs missing? https://t.co/JysSIvegX4
The amount of information to transform chimpanzee DNA into human DNA is about 8 megabytes.
— Yann LeCun (@ylecun) March 28, 2023
It took about 5 million years.
So we are talking 12 bits per year.
Not much.
This is Lukas Bergstrom's weblog. You can also find me on Twitter and LinkedIn.
Tech
Hardware, Visual, Audio, Web, Development, Open, s60, MacOS, Medical, AI, Data, Product Management, Energy, RSS, Automobile, Crowdsourcing, PIM, Security, OS, a11y, barcamp, Web analytics, Wearables, Social, Android, Javascript, WRX, Business, Net, Collaboration, Mobile, Shopping, Storage
Other
Feminism, Geography, Agriculture, Personal care, Quizzes, Surfing, Activism, Housing, Bicycling, Games, Law, Toys, Minnesota, Statistics, NYC, Friday, Food & Drink, Politik, Berlin, Life hacks, Sports, Transportation, California, CrowdFlower, Video, Clothes, Travel, History, L.A., San Francisco, Boston, Podcasts
Music
House, Events, Boston, Mixes, Videos, Musicians, Business, Good tracks, Mp3s, Making, L.A., History, Booking, Shopping, Streams, Lyrics, Mailing lists, Labels, Hip-hop, Reviews
People
ADD, MOTAS, Life hacks, Enemies, Subcultures, Me, Meditation, Heroes, Exercise, Weblogs, Languages, Health, Working with, Friends, Gossip, Vocations, Stories, Family
Arts
Rhetoric, iPad bait, Movies, Animation, Comix, Spoken Word, Literature, Humor, Events, Outlets, Poetry, Burning Man, Sculpture, Desktop wallpaper bait, Visual
Commerce
Microfinance, Web, Shopping, International Development, Management consulting, Taxes, Macroeconomics, Marketing and CRM, Personal finance, Insurance, Personal services, Real Estate, Non-profit, IP Law, Investing
Design
Tools, Process, User experience, Cool, Presentations, Web, Data visualization, Furniture, Architecture, Type, Algorithmic, IA
Science
Environment, Zoology, Physics, Statistics and Data, Networks, Psychology, Cognition
Travel
Vagabond '08, Kingdom of Siam, Kenya, Uganda