Bias built in to crime prediction

Posted to Statistics  |  Tags: , ,  |  Nathan Yau

Predictive policing seems to be playing a bigger role in court decisions these days. People charged with crimes can be given a risk score based on priors and their background, which represents a fuzzy likelihood that they commit a crime again. ProPublica investigates the reliability of these scores, using data from Broward County, Flordia, between 2013 and 2014

The score proved remarkably unreliable in forecasting violent crime: Only 20 percent of the people predicted to commit violent crimes actually went on to do so.

When a full range of crimes were taken into account — including misdemeanors such as driving with an expired license — the algorithm was somewhat more accurate than a coin flip. Of those deemed likely to re-offend, 61 percent were arrested for any subsequent crimes within two years.

So tons of uncertainty.

Then, when you compare scores for blacks and whites, taking into account the types of crimes committed, there appeared to be a bias towards scoring blacks at higher risk. Troubling. I suspect this is related to the mentioned factors like employment and education.

But still, with so much uncertainty case-by-case, should these numbers — that I can only imagine appearing nearly concrete in the court room — even be part of the equation of an individual’s future?

More on the ProPublica analysis here.

Favorites

Best Data Visualization Projects of 2016

Here are my favorites for the year.

The Best Data Visualization Projects of 2014

It’s always tough to pick my favorite visualization projects. Nevertheless, I gave it a go.

The Changing American Diet

See what we ate on an average day, for the past several decades.

Real Chart Rules to Follow

There are rules—usually for specific chart types meant to be read in a specific way—that you shouldn’t break. When they are, everyone loses. This is that small handful.