Metadata surveillance investigation

Posted to Statistics  |  Tags: ,  |  Nathan Yau

Metadata can tell you a lot, and most of us agree that it’s not “just metadata” at this point. The Share Lab shows what one can find, just using everyday tools and relatively straightforward analysis.

Although our investigation primarily discovered relations, patterns and anomalies of someone’s work life, it still gave us an insight into that person’s habits that border with private life. In the end, metadata scans someone’s behaviors on a much deeper level than traditional surveillance practice related to content could ever do.

The graphic above shows how people in the sample dataset emailed with others over. There’s no email content, but the headers provide enough information to sniff out connections.

See also: the search for Paul Revere with network analysis.

Favorites

Shifting Incomes for American Jobs

For various occupations, the difference between the person who makes the most and the one who makes the least can be significant.

10 Best Data Visualization Projects of 2015

These are my picks for the best of 2015. As usual, they could easily appear in a different order on a different day, and there are projects not on the list that were also excellent.

The Changing American Diet

See what we ate on an average day, for the past several decades.

Reviving the Statistical Atlas of the United States with New Data

Due to budget cuts, there is no plan for an updated atlas. So I recreated the original 1870 Atlas using today’s publicly available data.