Humans don't need to learn from 1 trillion words to reach human intelligence.
— Yann LeCun (@ylecun) March 28, 2023
What are LLMs missing? https://t.co/JysSIvegX4
The amount of information to transform chimpanzee DNA into human DNA is about 8 megabytes.
— Yann LeCun (@ylecun) March 28, 2023
It took about 5 million years.
So we are talking 12 bits per year.
Not much.
Tech
Social, Automobile, Hardware, Mobile, Development, Web analytics, Open, Product Management, Data, PIM, Android, s60, WRX, OS, Shopping, Audio, barcamp, Net, a11y, Security, Collaboration, Web, Crowdsourcing, Javascript, Business, Medical, AI, Energy, MacOS, Wearables, RSS, Storage, Visual
Other
Agriculture, History, Video, Feminism, Bicycling, Clothes, Activism, Quizzes, Sports, L.A., CrowdFlower, Surfing, Minnesota, Statistics, Food & Drink, Geography, Podcasts, California, Life hacks, Travel, Law, Personal care, Politik, NYC, Games, Toys, Boston, Berlin, San Francisco, Housing, Friday, Transportation
Music
Shopping, Business, Mp3s, Labels, Events, L.A., Boston, Musicians, Mailing lists, Reviews, Lyrics, Videos, House, Making, Hip-hop, Streams, Mixes, Booking, Good tracks, History
People
Subcultures, Meditation, Family, Enemies, Life hacks, Me, Weblogs, Exercise, Friends, Buddhism, Health, Journaling, Languages, Heroes, ADD, MOTAS, Vocations, Working with, Gossip, Stories
Commerce
Taxes, Non-profit, Shopping, Real Estate, Personal services, International Development, Microfinance, Management consulting, Macroeconomics, Insurance, Personal finance, Investing, Marketing and CRM, IP Law, Web
Arts
iPad bait, Rhetoric, Spoken Word, Burning Man, Animation, Humor, Comix, Visual, Events, Poetry, Literature, Sculpture, Outlets, Movies, Desktop wallpaper bait
Design
Data visualization, IA, Type, Furniture, Tools, Algorithmic, Process, User experience, Presentations, Cool, Architecture, Web
Science
Cognition, Statistics and Data, Zoology, Environment, Physics, Networks, Psychology
Travel
Vagabond '08, Uganda, Kingdom of Siam, Kenya