Tabula, by Manuel Aristarán, came out months ago, but I’ve been poking at government data recently and came back to this useful piece of free software to get the data tables out of countless free-floating PDF files.

If you’ve ever tried to do anything with data provided to you in PDFs, you know how painful this is — you can’t easily copy-and-paste rows of data out of PDF files. Tabula allows you to extract that data in CSV format, through a simple interface.

It’s not the fastest software in the world, but it really is simple to use and it sure beats manual entry. You just load a PDF file into Tabula, which runs on your computer, highlight the table to extract, and the program does the rest. Save as a CSV and do what you want with it.

Download Tabula here. Find out a little more about it on Source.

FloatingSheep pointed their Twitter geography towards beer (and wine).

From Sam Adams in New England to Yuengling in Pennsylvania to Grain Belt and Schlitz in the upper Midwest, these beers are quite clearly associated with particular places. Other beers, like Hudepohl and Goose Island are interesting in that they stretch out from their places of origin — Cincinnati and Chicago, respectively — to encompass a much broader region where there tend to be fewer regionally-specific competitors, at least historically. On the other hand, beers like Lone Star, Corona and Dos Equis tend to have significant overlap in their regional preferences, with all three having some level of dominance along the US-Mexico border region, but with major competition between these brands in both Arizona and Texas.

This of course excludes the increased appreciation for craft beer, as there isn’t enough data for significant microbrewery results.

Because Fox News. See also this, this, and this. [Thanks, Meron]

Tim Harford for Financial Times on big data and how the same problems for small data still apply:

The multiple-comparisons problem arises when a researcher looks at many possible patterns. Consider a randomised trial in which vitamins are given to some primary schoolchildren and placebos are given to others. Do the vitamins work? That all depends on what we mean by “work”. The researchers could look at the children’s height, weight, prevalence of tooth decay, classroom behaviour, test scores, even (after waiting) prison record or earnings at the age of 25. Then there are combinations to check: do the vitamins have an effect on the poorer kids, the richer kids, the boys, the girls? Test enough different correlations and fluke results will drown out the real discoveries.

You’re usually in for a fluffy article about drowning and social media when ‘big data’ is in the title. This one is worth the full read.

The New York Public Library announced open access to 20,000 maps, making them free to download and use.

The Lionel Pincus & Princess Firyal Map Division is very proud to announce the release of more than 20,000 cartographic works as high resolution downloads. We believe these maps have no known US copyright restrictions.* To the extent that some jurisdictions grant NYPL an additional copyright in the digital reproductions of these maps, NYPL is distributing these images under a Creative Commons CC0 1.0 Universal Public Domain Dedication. The maps can be viewed through the New York Public Library’s Digital Collections page, and downloaded (!), through the Map Warper

Begin your journey.

From Cakecrumbs, a product that helps you learn while you eat: planetary layer cakes. The graduate student slash baker hobbyist’s sister asked if she could make one, and at first she thought it couldn’t be done. But then she thought more about it.

I spent the rest of the afternoon thinking about it. I don’t admit defeat. Ever. But especially not with cake. Nothing is impossible is pretty much my baking motto, so to say this cake was impossible left me feeling weird. There had to be a way. A way that didn’t involve carving or crumbing the cake. I kept mulling it over until I had a breakthrough.

See how it was done.

Citi Bike, also known as NYC Bike Share, is releasing monthly data dumps for station check-outs and check-ins, which gives you a sense of where and when people move about the city. Jeff Ferzoco, Sarah Kaufman, and Juan Francisco Saldarriaga mapped 24 hours of activity in the video below.

[Thanks, Jeff]

Remember the Million Dollar Homepage from 2005? It sold ad space to anyone who was interested for one dollar per pixel, and there were one million pixels available. All spots were filled, and it gave a burst of bunch of other million dollar homepages that turned out to be zero dollar homepages.

David Yanofsky for Quartz returned to the homepage to look at link rot. 22 percent of links on the homepage are dead.

Hibai Unzueta, based on a paper by Albert Bartlett, demonstrates exponential growth with a simple animation. It depicts a man standing in a tank with finite capacity and water rising slowly, but at an exponential rate.

Our brains are wired to predict future behaviour based on past behaviour (see here). But what happens when something growths exponentially? For a long time, the numbers are so little in relation to the scale that we hardly see the changes. But even at moderate growth rates exponential functions reach a point where the numbers grow too fast. Once we confirm that our predictions about the future have failed, very little time to react may be left.

All looks safe at first, because the water rises so slowly, but it seems to rise all of a sudden. Oh, the suspense. What will happen to cartoon pixel man?

The Centennia Historical Atlas is a program that shows you border changes in Europe and the Middle East, from the 11th century to the present. It’s meant as an educational tool. The video below is the animated map from the program set to climactic music from the movie Inception.

Now contrast that to the original promotional video for Centennia. I’m amused. [via @sogrady]

Based on a study on smoking prevalence from 1996 to 2012, a map by The New York Times shows the results. Smoking rates among men and women have declined overall over the years, but there are still relatively high rates in many areas of the country, which appears to correlate with income. Lower income tends towards higher smoking rates.

That would explain why the map above looks similar to a county-level map for median household income, which probably interacts with life spans by county somehow.

Patricio Gonzalez Vivo, an MFA Design & Technology student, scraped depth from Google Streetview and then reconstructed it in openFrameworks. The result is Point Cloud City. See it in action in the video below.

Dreamlike.

Now I’m curious what else can be gleaned from this data, because this essentially means you could get really detailed data about the makeup of places, down to the window of a building. Although I don’t imagine Google will let this stay so accessible for long. [Thanks, @pixelbeat]

Jen Lowe tracks her heart rate with a Basis watch, and she’s showing the last 24 hours of that data in One Human Heartbeat.

Basis doesn’t provide an open API, so I access the data using a variation of this code. The heartrate you see is from 24 hours ago. This is because the data can only be accessed via usb connection. Twice a day I connect the watch and upload my latest heartrates to the database. I’ve been doing this for 33 days now.

It’s March 25, 2014, and statistics say I have about 16452 days left.

On the surface, it’s just a pulsating light on a screen, but somehow it feels like more than that. The countdown aspect makes me uneasy, as if I were watching a ticker on someone’s life, or my own even. I want to keep watching though, because it continues to pulsate. It’s hopeful.

Seth Kadish looked at the road network of several major counties and estimated the directions the streets run. The result is a set of charts that shows which cities use a grid system and those that don’t.

If you’re like me, and you use the Sun to navigate, you probably appreciate cities with gridded street plans that are oriented in the cardinal directions. If you know that your destination is due west, even if you hit a dead end or two, you’ll be able to get there. However, not all urban planners settled on such a simple layout for road networks. For some developers, topography or water may have gotten in the way. Others may not have appreciated the efficiency of the grid. This visualization assesses those road networks by comparing the relative degree to which they are gridded.

Whoa, Charlotte.

Since the original, Kadish has added more counties and a handful of international cities.

Kevin Wu made a straightforward interactive that lets you see IMDB television ratings over time, per episode and by season.
Read More

Stamen visualized Bitcoin activity, noting a variety of traders who knew what they were doing, didn’t know what they were doing, and were apparently automated.

In February 2014 MtGox, one of the oldest Bitcoin exchanges, filed for bankruptcy protection. On March 9th a group posted a data leak, which included the trading history of all MtGox users from April 2011 to November 2013. The graphs below explore the trade behaviors of the 500 highest volume MtGox users from the leaked data set. These are the Bitcoin barons, wealthy speculators, dueling algorithms, greater fools, and many more who took bitcoin to the moon.

With player tracking installed in all of the NBA arenas, the sports analytics folks can essentially replay entire games through data and dissect the many facets of play. Andrew Bergmann looked at the passing averages between starters on each team.

The thickness of the gray lines on the accompanying chart represents the average number of passes per game between two players.

A very clear picture emerges on which teams distribute the ball more evenly between players, such as the Nets, Bulls and Cavaliers. On the flip side, Chris Paul and Blake Griffin dominate passing for the Clippers, and likewise for Kevin Love and Ricky Rubio of the Timberwolves.

These connections are non-directional, so it hides a little bit, but you still get a good sense of who the offense runs through based on the sum-width of connections from an individual. You can also easily see team ball distribution, which is the point of the graphic.

Next step: match ups. I bet that’s where the money’s at. We’ve seen a lot of analyses and graphics that show the activity of a single team, but ultimately, you want to know how your team plays against others in your division and playoff contenders. Ideal gameplay against subpar teams? Not so important.

Pantheon, a project from the Macro Connections group at The MIT Media Lab, explores cultural influences across countries and domains.

To make our efforts tractable, Pantheon will not focus on culture, as it is understood in its broadest sense, but on cultural production. In a broad sense, culture can be understood as all of the information that humans—or animals [1]—generate and transmit through non-genetic means [2]. At Pantheon, however, we do not focus on the entire range of cultural information, but in a subset of this information that we define narrowly as cultural production. That is, we do not focus on cultural information such as passed on family values or societal trust [3], but on cultural production as proxied by the biographies of notable historical characters. Moreover, we focus on the subset of cultural production that we can identify as global culture, meaning the subset of cultural production that has broken the barriers of space, time and language.

Rankings inevitably come into play, such as who the most influential philosopher, physicist, or country is, and the project covers a broad spectrum, so the methodology is the most important here. Using data from Wikipedia, Freebase, and other online sources, the researchers created several indices that essentially give a score to individuals for popularity and production. This naturally results in estimation fuzziness, which means you take the results with salt and all that.

It’s an interesting look though and a good start to something bigger. If anything, you’ll probably learn something new after poking around for a bit.