Humans don't need to learn from 1 trillion words to reach human intelligence.
— Yann LeCun (@ylecun) March 28, 2023
What are LLMs missing? https://t.co/JysSIvegX4
The amount of information to transform chimpanzee DNA into human DNA is about 8 megabytes.
— Yann LeCun (@ylecun) March 28, 2023
It took about 5 million years.
So we are talking 12 bits per year.
Not much.
This is Lukas Bergstrom's weblog. You can also find me on Twitter and LinkedIn.
Tech
Web, AI, barcamp, Social, Shopping, Medical, Audio, Product Management, OS, Open, a11y, Collaboration, Development, Web analytics, Wearables, Energy, Mobile, Business, PIM, Data, s60, Visual, WRX, Automobile, Security, Hardware, Net, MacOS, Crowdsourcing, Javascript, Storage, RSS, Android
Other
Sports, California, Activism, Agriculture, Statistics, Law, Food & Drink, Housing, Friday, San Francisco, History, Personal care, Games, Transportation, Geography, Travel, Life hacks, Politik, CrowdFlower, Bicycling, Boston, Minnesota, Feminism, Berlin, Toys, Video, Quizzes, Clothes, Podcasts, NYC, Surfing, L.A.
Music
Streams, Events, Making, Hip-hop, Lyrics, History, Good tracks, Mixes, Shopping, Labels, Musicians, Booking, Business, House, Videos, Mailing lists, Mp3s, Reviews, Boston, L.A.
People
Weblogs, Stories, Exercise, Life hacks, Subcultures, Health, Friends, Enemies, Heroes, Family, Buddhism, Me, Vocations, Gossip, MOTAS, ADD, Working with, Languages, Meditation
Commerce
Personal services, Macroeconomics, Microfinance, Non-profit, IP Law, Shopping, Web, Marketing and CRM, Insurance, International Development, Management consulting, Taxes, Investing, Real Estate, Personal finance
Arts
Burning Man, Sculpture, Literature, Animation, Visual, Rhetoric, Comix, Outlets, Poetry, Desktop wallpaper bait, Spoken Word, Events, Humor, Movies, iPad bait
Design
Tools, Web, Cool, Type, IA, Architecture, Furniture, Process, Data visualization, Presentations, User experience, Algorithmic
Science
Networks, Zoology, Physics, Cognition, Environment, Psychology, Statistics and Data
Travel
Vagabond '08, Kenya, Uganda, Kingdom of Siam