vague, but exciting

the porous city - other - statistics

/

/

email me

/

about

Statistical data mining tutorials
Tutorial slides

A ton of short useful tutorials here.

Is there a general factor of intelligence?
Because of my personal beliefs (one could say biases) I have never accepted the idea that there's a meaningful underlying factor of intelligence g. Cosma Shalizi doesn't buy the existing evidence either.
. . . the case for g rests on a statistical technique, factor analysis, which works solely on correlations between tests. Factor analysis is handy for summarizing data, but can't tell us where the correlations came from; it always says that there is a general factor whenever there are only positive correlations. The appearance of g is a trivial reflection of that correlation structure. A clear example, known since 1916, shows that factor analysis can give the appearance of a general factor when there are actually many thousands of completely independent and equally strong causes at work. Heritability doesn't distinguish these alternatives either. Exploratory factor analysis being no good at discovering causal structure, it provides no support for the reality of g.

. . .

To paraphrase Hume:

When we run over libraries, persuaded of these principles, what havoc must we make? If we take in our hand any paper; of macroeconomics or correlational psychology, for instance; let us ask, Does it draw its causal inferences from observations with consistent methods? No. Does it draw its causal inferences from experiments, controlled or randomized? No. Commit it then to the recycling bin: for it can contain nothing but sophistry and illusion.

Bayes and fitting models to data
It's increasingly clear that I need to be stats-literate. Here are the first two posts in a series that Carson Chow is planning on Bayesian statistics, the Markov chain Monte Carlo method, and fitting models to data.


Other relevant links:

Tech
Energy, Web analytics, barcamp, Android, Collaboration, a11y, Data, MacOS, Storage, s60, Product Management, Crowdsourcing, Social, Open, Shopping, Web, RSS, Business, Mobile, OS, Javascript, Medical, PIM, WRX, Wearables, Automobile, Security, Development, Net, Audio, Hardware, Visual

Other
Agriculture, Video, Feminism, Surfing, Minnesota, Toys, CrowdFlower, Berlin, San Francisco, Statistics, L.A., Geography, Life hacks, Games, Law, Housing, Activism, Bicycling, Boston, Friday, Quizzes, History, Food & Drink, Sports, Podcasts, Travel, Personal care, Politik, Transportation, Clothes, NYC

Music
Good tracks, Boston, Mp3s, L.A., Mixes, Reviews, Booking, Hip-hop, History, Streams, Labels, Making, Mailing lists, Lyrics, Musicians, Business, Videos, Shopping, Events, House

People
Family, Enemies, Health, Friends, Stories, Subcultures, Working with, Meditation, Heroes, ADD, Life hacks, Vocations, Exercise, Languages, Weblogs, Me, MOTAS, Gossip

Arts
Animation, Events, iPad bait, Poetry, Desktop wallpaper bait, Movies, Outlets, Rhetoric, Spoken Word, Comix, Sculpture, Literature, Visual, Humor, Burning Man

Commerce
International Development, Non-profit, Management consulting, Taxes, IP Law, Investing, Shopping, Personal finance, Macroeconomics, Insurance, Personal services, Microfinance, Marketing and CRM, Real Estate, Web

Design
Cool, IA, Type, User experience, Process, Architecture, Tools, Data visualization, Algorithmic, Presentations, Furniture, Web

Science
Physics, Psychology, Networks, Environment, Statistics and Data, Zoology

Travel
Kenya, Uganda, Vagabond '08, Kingdom of Siam

Photos
Photos I Wish I'd Taken, Moblog, Friends

Philosophy
Mind

Internet classic

One Acre Fund

Mathematics

Subscribe to this site's rss feed