Graduate student makes up data for fake findings

Posted to Mistaken Data  |  Tags: ,  |  Nathan Yau

Last month, This American Life ran a story about research that asked if you could change people’s mind about issues like same-sex marriage and abortion — with just a 22-minute conversation. The research was published in Science, but Donald Green asked the publication to retract the paper recently. It seems his co-author and UCLA graduate student, Michael LaCour, made up a lot of data.

Green today told me if there was no survey data, what’s incredible is that LaCour produced all sorts of conclusions and evaluations of data that didn’t exist. For instance, he had “a finding comparing what people said at the door to canvassers to what they said on the survey,” according to Green. “This is the thing I want to convey somehow. There was an incredible mountain of fabrications with the most baroque and ornate ornamentation. There were stories, there were anecdotes, my dropbox is filled with graphs and charts, you’d think no one would do this except to explore a very real data set.”

“All that effort that went in to confecting the data, you could’ve gotten the data,” says Green.

Bizarre.

Stanford and Berkeley researchers found that something seemed off when they tried to reproduce the results. Their full report is available for reading, which includes the data in question and R code that explains their reasoning.

Perhaps one should note that the dataset is not definitely a fake. Noted by the examiners:

No one of the irregularities we report alone constitutes definitive evidence that the data were not collected as described. However, the accumulation of many such irregularities, together with a clear alternative explanation that fits the data well, leads us to be skeptical the data were collected as described.

And it was enough for Green to request a retraction, so there’s that.

With this in mind, it’s especially interesting to visit LaCour’s website, which includes a lot of graphs from the original study. Graphs, which typically lend a feeling of concreteness to a subject — especially scientific research — almost have an opposite effect.

Survey effects

LaCour is currently “gathering evidence” to provide a comprehensive rebuttal.

Update: More details from This American Life. It gets weirder.

Favorites

The Most Unisex Names in US History

Moving on from the most trendy names in US history, let’s look at the most unisex ones. Some names have …

How You Will Die

So far we’ve seen when you will die and how other people tend to die. Now let’s put the two together to see how and when you will die, given your sex, race, and age.

Divorce Rates for Different Groups

We know when people usually get married. We know who never marries. Finally, it’s time to look at the other side: divorce and remarriage.

Best Data Visualization Projects of 2016

Here are my favorites for the year.