Deep fried data

Posted to Statistics  |  Tags: , ,  |  Nathan Yau

Maciej Ceglowski, the creator of bookmarking site Pinboard, spoke at the Library of Congress a couple of weeks ago about deep-fried data.

In our case, the deep-fryer is a toolbox of statistical techniques. The names keep changing—it used to be unsupervised learning, now it’s called big data or deep learning or AI. Next year it will be called something else. But the core ideas don’t change. You train a computer on lots of data, and it learns to recognize structure.

These techniques are effective, but the fact that the same generic approach works across a wide range of domains should make you suspicious about how much insight it’s adding.

And in any deep frying situation, a good question to ask is: what is this stuff being fried in?

Deep fried food is often delicious, regardless of what’s inside the golden breading. But deep inside — or really right there in the front of our minds — we know it’s not good for us. Moderation. Or at least make sure you go to the good food stand at the carnival that uses the clean oil.

See the talk and many others here.

Favorites

How You Will Die

So far we’ve seen when you will die and how other people tend to die. Now let’s put the two together to see how and when you will die, given your sex, race, and age.

Watching the growth of Walmart – now with 100% more Sam’s Club

The ever so popular Walmart growth map gets an update, and yes, it still looks like a wildfire. Sam’s Club follows soon after, although not nearly as vigorously.

Famous Movie Quotes as Charts

In celebration of their 100-year anniversary, the American Film Institute selected the 100 most memorable quotes from American cinema, and …

Most popular porn searches, by state

We’ve seen that we can learn from what people search for, through the eyes of Google suggestions: state stereotypes, national …