Comparing current data boom to past waves

Jun 8, 2011

Pete Warden, for O’Reilly Radar, compares current data responsibilities with those of harbor masters from the Victorian era. Warden warns:

Specialists like us who can understand and interpret data are in a privileged position. Most people have an exaggerated respect for arguments expressed as numbers or visualizations, because they don’t understand how many assumptions and simplifications go into these creations. It’s our job to remember that and balance our enthusiasm about the power of our techniques with some humility about their limits.

In other words: You should learn statistics. You don’t have to go out and get a PhD, but it’s helpful to be able to think like a statistician, so that you know the right way to think about data.

Favorites

A Day in the Life of Americans

I wanted to see how daily patterns emerge at the individual level and how a person’s entire day plays out. So I simulated 1,000 of them.

Pizza Place Geography

Most of the major pizza chains are within a 5-mile …

Reviving the Statistical Atlas of the United States with New Data

Due to budget cuts, there is no plan for an updated atlas. So I recreated the original 1870 Atlas using today’s publicly available data.

Famous Movie Quotes as Charts

In celebration of their 100-year anniversary, the American Film Institute …