In football video game Madden, NFL players are scored based on skill, which determines how they play in the game. Neil Paine, with graphics by Reuben Fischer-Baum, describes more than you ever thought you wanted to know about the scoring process in an in-depth look for FiveThirtyEight. At the heart of the process is Donny Moore, who is in charged of most of the (subjective) number assignments.
Read More

Inspired by the Python libraries RoboBrowser and BeautifulSoup, the rvest package by Hadley Wickham helps you scrape web data via R in a similar way.

Parse tables into data frames, navigate around a website, and of course, extract bits from a page. I’ll stick to BeautifulSoup, but I’m saving this for later. I’m sure it’ll come in handy sooner rather than later.

Planet Money goes back to a 1984 article by Steven Levy that discusses this new thing called a spreadsheet. It was taking the place of the paper version that accountants manually edited, added to, and taped together.
Read More

Software engineer Chris Beaumont visualized the strength of opponent hands in Texas hold ’em, given any other hand. This is based on counting about 1.3 trillion possible combinations.
Read More

Michael Beuoy’s win probability model plotted on FiveThirtyEight starts all NBA teams at a 50% chance of winning. Then the probability of winning a game increases and decreases from there. However, practically speaking, we know something about the teams before each game, and we don’t give even chances to the worst and best team at the zero-minute mark.

So Todd Schneider took a different approach to minute-by-minute win probability — from a gambling perspective. Each line in the time series starts closer to the end probability as gamblers wager based on what they think the final outcome will be.
Read More

Michael Beuoy made a win probability model for NBA teams and games, based on play-by-play data from 2000 to 2012. The basic calculator lets you punch in the game state, such as time left and the score difference, and it spits out the probability of a win.

Or, for a team-centric view, you can see the chart from Beuoy and Allison McCann for FiveThirtyEight, which plots the average probability using the same model. Steady rise means a steady pull towards a win, whereas spikes and steeper, positive slopes mean a tendency towards scoring spurts.

Jonathan Dushoff had issues with students in his population biology class cheating on his exams. One year there was suspicious behavior, but Dushoff and the proctors weren’t able to prove the students cheated as it happened. So he looked closely at the test results to find the guilty students.
Read More

Bayes’ theorem is covered in introduction to statistics and probability courses, but I think a lot of people starting out don’t understand it conceptually. They see a formula that you plug numbers into. Here’s an example using LEGO bricks that clarifies the confusion, hopefully.

Did you hear the news? The White House officially appointed DJ Patil as the federal government’s first ever Chief Data Scientist. Awesome.

Here’s Patil, with an introduction by President Barack Obama, on what’s in store and a recruitment note for the US Digital Services.
Read More

Artist Alberto Frigo took a picture of every object he used with his right hand for the past 11 years. Averaging 76 photos per day, the project — Images of the artifact used by the main hand — is low-tech, with just a small, hand-held camera. No internet connection, tagging, or documentation. Just a stream of photos.

Frigo aims to do this until age 60, so he has only 25 more years to go. Yep.

Quoctrung Bui for Planet Money plotted average income for the top one percent of earners against the average income of the bottom 90%, from 1920 to 2012. Through the 1970s, the animation shows rising income for the bottom and relatively static for the top and then vice versa after that.
Read More

Not that anyone who does not vaccinate their kids cares, but Tynan DeBold and Dov Friedman for the Wall Street Journal show the change in number of cases for various diseases after a vaccination is introduced.
Read More

Because using Tinder takes up oh so much time swiping, swiping, and swiping, Justin Long made a bot that swipes and starts conversations for him. Step 1: Use his existing preferences to create two Eigenfaces, commonly used in face recognition, that represent a yes and a no. Step 2: Automate everything else with the Tinder API.
Read More

Watch one bird fly around, and it’s hard to make out its flight pattern. Time shift multiple copies of that bird, creating an echo effect, and it’s easy. Parker Paul did this with seagulls flapping around at the beach and After Effects.
Read More

The Sid Lee agency in Paris has Arduino-powered sensors hooked up throughout their office, and they brought the data together in a single dashboard. The result is a fun look into the inner workings of the agency in real-time.
Read More

Audio Landscape is a novel music visualizer that constructs a landscape based on the MP3 that you give it. As you fly overhead, you can see the mountains constructed in the distance. (You probably want to open Chrome for this one. Safari kind of buckled for me.)

There is no more reason to expect one graph to “tell all” than to expect one number to do the same.

—John Tukey, Exploratory Data Analysis, 1977.

In the first song of his music experiment Data-Driven DJ, visual artist Brian Foo used median household income data to create a song that represents a ride on a New York subway.
Read More