Humans don't need to learn from 1 trillion words to reach human intelligence.
— Yann LeCun (@ylecun) March 28, 2023
What are LLMs missing? https://t.co/JysSIvegX4
The amount of information to transform chimpanzee DNA into human DNA is about 8 megabytes.
— Yann LeCun (@ylecun) March 28, 2023
It took about 5 million years.
So we are talking 12 bits per year.
Not much.
This is Lukas Bergstrom's weblog. You can also find me on Twitter and LinkedIn.
Tech
Javascript, Business, Collaboration, MacOS, Open, Data, Wearables, Web analytics, Visual, Development, PIM, barcamp, Crowdsourcing, Energy, Web, Medical, RSS, s60, Mobile, Storage, OS, Shopping, Hardware, WRX, Social, Audio, Net, a11y, Automobile, Product Management, AI, Android, Security
Other
Boston, California, Geography, Housing, Politik, Agriculture, Toys, Transportation, Berlin, Clothes, Surfing, Travel, Quizzes, San Francisco, Statistics, Food & Drink, Friday, Life hacks, Video, Activism, Feminism, CrowdFlower, Sports, NYC, L.A., Law, History, Personal care, Games, Bicycling, Podcasts, Minnesota
Music
Mixes, Mailing lists, Good tracks, Making, Events, Hip-hop, Reviews, Mp3s, L.A., Shopping, History, House, Business, Boston, Lyrics, Musicians, Labels, Videos, Booking, Streams
People
Weblogs, Enemies, MOTAS, Friends, ADD, Health, Meditation, Vocations, Subcultures, Stories, Family, Exercise, Life hacks, Working with, Gossip, Buddhism, Languages, Me, Heroes
Commerce
Personal services, Insurance, IP Law, Management consulting, Taxes, Marketing and CRM, Microfinance, Non-profit, Real Estate, Shopping, Personal finance, Macroeconomics, Investing, International Development, Web
Arts
Poetry, Visual, Desktop wallpaper bait, Humor, Events, iPad bait, Rhetoric, Literature, Movies, Spoken Word, Outlets, Burning Man, Animation, Comix, Sculpture
Design
Cool, Data visualization, Process, Web, Algorithmic, Architecture, Furniture, User experience, IA, Presentations, Tools, Type
Science
Psychology, Cognition, Environment, Zoology, Physics, Networks, Statistics and Data
Travel
Vagabond '08, Kingdom of Siam, Uganda, Kenya