Showing uncertainty during the live election forecast

During the election, The New York Times showed a live gauge to show the current forecast for Clinton and Trump. It moved to show a 25th to 75th percentile band of uncertainty:

Jittery gauge

A lot of people didn’t get it, and it seemed to upset plenty of people too. Gregor Aisch, an NYT graphics editor, explains what they tried to accomplish with the gauges.

[W]e thought (and still think!) this movement actually helped demonstrate the uncertainty around our forecast, conveying the relative precision of our estimates. In our opinion, having the dial fluctuate a small amount – bound by the 25th and 75 percentile of simulated outcomes – was more successful at conveying the uncertainty around our forecast than simply listing what those percentiles were. As the night went on, the gauges fluctuated less and less as our forecast became more precise. By the end of the night, the gauges barely moved.

So it wasn’t just random jitter that some suggested.

I’m curious if a brief explanation of the needle movement would’ve made people less upset. I was a little confused too when I first saw it but an explanation on Twitter cleared things up quick.

Or, maybe it was just subject matter. I used movement to show uncertainty a couple of months back, and there was confusion, but it was definitely sans anger.

Maybe it was the choice of metaphor that confused people. Think of what gauges usually show in your everyday. There are speedometers in a car, thermometers in the kitchen or outside, and pressure gauges in air pumps. If any of those jittered, you’d be confused or assume something broke. So that’s something to consider.

Mainly though, I think most people don’t have a good grasp on uncertainty and how it relates to data, which makes me think this is more of a data literacy challenge than it is a visualization one. Data is often looked to as a place of concreteness and definite answers, but really, statistics is the study of chance, non-guarantees, and yes, uncertainty. From a statistician’s point of view, it’s a greater disservice to readers to not show uncertainty.

Oftentimes, the uncertainty is far more important than the estimate that it’s attached to. How do you get the general public to understand more concretely? I’m still not sure.

Favorites

The Most Unisex Names in US History

Moving on from the most trendy names in US history, let’s look at the most unisex ones. Some names have …

19 Maps That Will Blow Your Mind and Change the Way You See the World. Top All-time. You Won’t Believe Your Eyes. Watch.

Many lists of maps promise to change the way you see the world, but this one actually does.

Life expectancy changes

The data goes back to 1960 and up to the most current estimates for 2009. Each line represents a country.

Divorce Rates for Different Groups

We know when people usually get married. We know who never marries. Finally, it’s time to look at the other side: divorce and remarriage.