Yesterday I visited the ever popular NYU ITP bi-annual show which is a showcase of the students' experimental and ingenious interactive work.

I stopped to talk to data visualization student and self-tracker, Doug Kanter, about his work. His first and smaller piece was about the war in Iraq. The image above depicts the number of wounded US soldiers by state (and territory) using the red stripes. The stars show the number of soldiers killed. I'm sure we could quibble about labels and where the bar chart starts, but to me, the tattered appearance of the flag created by data about war is very arresting.
Continue Reading

I'm going to be away for a couple of weeks, with little to no Internet access most of the time, so I've asked Kim Rees to step in while I'm gone. She's the co-founder of Periscopic, one of my favorite information visualization firms, and she was the technical editor for Visualize This. You're in good hands.

You can follow her at @krees.

Be good, and see you all when I get back.

She's all yours, Kim.

Nicolas Rapp dives into the patterns and growth of worldwide shipping in a six-page spread for Fortune Magazine.

Nearly 90% of all goods traded across borders travel, in part, by sea. Typically a ship will undertake six voyages a year. The fastest-growing routes are between ports in Asia, while goods moving out of that continent account for 43% of all maritime trade, according to IHS Global, an economic forecasting firm. Today the most heavily trafficked sea route is between China and the West Coast of the U.S. The total value of goods that travel from China to the U.S. is four times that of those on the return trip—a clear symbol of America's trade deficit.

Despite a gap of a few centuries, the routes today still look a lot like the ones from the 18th century.

I'm pretty sure I'm not in their target audience, but my main takeaway from this video is that now, with easel.ly, you don't need time, money, or skill to make quality infographics. And the prezi-like video seems fitting.

Maybe I'm just stuck in my ways, but I'm having trouble getting on board with these tools. Easel.ly, for example, provides themes, such as the one on the right. There's a guy in the middle with graphs around him and pointers coming out of his body. You get to edit however you want.

So in this case, you start with a complete visual and then work your way backwards to the data, which I'm not sure how you can edit other than manually changing the size of the graphs. (Working with the interface takes some patience at this stage in the application's life.) It's rare that good graphics are produced when you go this direction.

Instead, start with the data (or information) first and then build around that — don't try to fit the data (or information) into a space it wasn't meant for.

Or maybe there's a lot more in store that we can't see yet. Either way, right now, the application is rough at best.

Robert Groves, director of the U.S. Census Bureau, on the Appropriations Bill:

The Appropriations Bill eliminates the Economic Census, which measures the health of our economy. It terminates the American Community Survey, which produces the social and demographic information that monitors the impact of economic trends on communities throughout the country. It halts crucial development of ways to save money on the next decennial census. In the last three years the Census Bureau has reacted to budget and technological challenges by mounting aggressive operational efficiency programs to make these key statistical cornerstones of the country more cost efficient. Eliminating them halts all the progress to build 21st century statistical tools through those innovations. This bill thus devastates the nation’s statistical information about the status of the economy and the larger society.

A lot of the negative comments following the post are from people who have never used Census data, or any substantial amount of data for that matter, and have no clue how a dataset can feed into a model to make other estimates. Then there's the people who don't want to answer questions about their toilets. I wonder what their Facebook profiles look like.

Princeton history graduate student Benjamin Schmidt explores changes in language through TV anachronisms. In Schmidt's most recent analysis, he examines Megan's use of "callback" in the last episode of Mad Men. Above is the ratio of modern use to period use. Notice callback sticking out in the top left.

The big one from the charts: Megan gets "a callback for" an audition. This is, the data says, a candidate for the worst anachronism of the season. The word "callback" is about 100x more common by the 1990s, and "callback for" is even worse. The OED doesn't have any examples of a theater-oriented use of "callback" until the 1970s; although I bet one could find some examples somewhere earlier in the New York theater scene, that may not save it. It wouldn't really suite Megan's generally dilettantish attitude towards the theater, or the office staff's lack of knowledge of it, for them to be so au courant. "call-back" and "call back" don't seem much more likely.

Other anachronisms include the use of "pay phone" and a frequent use of "on the phone with" which didn't peak until the 1970s.

Don't miss the look into Downton Abbey anachronisms. Also, more details from Schmidt on his methodology.

[via Revolutions]

Music visualization with stop motion board games. You can't go wrong.

[via @jcukier]

Jerzy Wieczorek, a statistician with the U.S. Census Bureau, explains why the American Community Survey is worthwhile.

Besides the direct estimates from the ACS itself, the Census Bureau uses ACS data as the backbone of several other programs. For example, the Small Area Income and Poverty Estimates program provides annual data to the Department of Education for use in allocating funds to school districts, based on local counts and rates of children in poverty. Without the ACS we would be limited to using smaller surveys (and thus less accurate information about poverty in each school district) or older data (which can become outdated within a few years, such as during the recent recession). Either way, it would hurt our ability to allocate resources fairly to schoolchildren nationwide.

Similarly, the Census Bureau uses the ACS to produce other timely small-area estimates required by Congressional legislation or requested by other agencies: the number of people with health insurance, people with disabilities, minority language speakers, etc. The legislation requires a data source like the ACS not only so that it can be carried out well, but also so its progress can be monitored.

Last month Republicans were pushing a bill to get rid of the American Community Survey, an 11-page questionnaire about housing, education, and other things. Yesterday, a bill passed to cut the survey in a 232 to 190 vote.

Republicans, acknowledging its usefulness, attacked the survey as an unconstitutional invasion of privacy, arguing that the government has no business knowing how many flush toilets someone has, for instance.

"It would seem that these questions hardly fit the scope of what was intended or required by the Constitution," said Rep. Daniel Webster (R-Fla.), author of the amendment.

"This survey is inappropriate for taxpayer dollars," Webster added. "It's the definition of a breach of personal privacy. It's the picture of what's wrong in Washington, D.C. It's unconstitutional."

The ACS is the picture of what's wrong in Washington? This is idiocy.

Thanks to the Internet Archive and CNN, thirteen years of transcripts, about a gigabyte compressed, is available to download as one file.

For over a decade, CNN (Cable News Network) has been providing transcripts of shows, events and newscasts from its broadcasts. The archive has been maintained and the text transcripts have been dependably available at transcripts.cnn.com. This is a just-in-case grab of the years of transcripts for later study and historical research.

Changes in news coverage and CNN's focus over the years, anyone?

[via @A_L]

Gay rights vary across states and by region. The Guardian US interactive team does their research and shows this variance, covering several issues, from school to marriage. Segmented concentric circles make the foundation of the interactive where each circle is an issue, and each segment is a state. The states are organized by region, so it's easy to see where areas of the country stand.

Be sure to scroll down for regional breakdowns by issue.

Nice work from both a technical and storytelling standpoint.

The series premiere of United Stats of America (See what they did there?) on History is tonight at 10/9c.

Episodes explore the stats that help us understand how much money we make (and what we spend it on), how long we will live (and how we will die), what we do with our free time (and how to make more of it) and a whole lot more. In one episode, the Sklars explain how the deadliest animal in America is neither the snake nor the shark but rather the deer. In another, viewers learn that Americans waste 4.2 billion hours a year stuck in traffic and that, in a nation with over 3.5 million square miles of territory, 99 percent of us are crowded into only 8 percent of the land.

I watched a couple of clips and got bored quickly as they went through a bunch of numbers. It seems like a rehash of Yahoo and Huffington Post lists with jokes. I'm setting my expectations low, but maybe there'll be more to it in the full episodes.

[Thanks, Gary]

Researchers at the School of Computer Science at Carnegie Mellon University investigate the structure of cities in Livehoods, using foursquare check-ins.

The hypothesis underlying our work is that the character of an urban area is defined not just by the the types of places found there, but also by the people who make the area part of their daily routine. To explore this hypothesis, given data from over 18 million foursquare check-ins, we introduce a model that groups nearby venues into areas based on patterns in the set of people who check-in to them. By examining patterns in these check-ins, we can learn about the different areas that comprise the city, allowing us to study the social dynamics, structure, and character of cities on a large scale.

It's most interesting when you click on location dots. A Livehood is highlighted and a panel on the top right tells you what the neighborhood is like, related neighborhoods, and provides stats like hourly and daily pulse and a breakdown location categories (for example, food and nightlife). Does foursquare have anything like this tied into their system? They should if they don't.

There's only maps for San Francisco, New York City, and Pittsburgh right now, but I'm sure there are more to come.

Want more on the clustering behind the maps? Here's the paper [pdf].

Welcome to Anthropocene:

Scientific concepts like the Anthropocene, planetary boundaries and planetary stewardship have heralded a profound shift in perception of our place in the world: a growing evidence base of scientific observations show we have become the prime driver of global environmental change. These new concepts are powerful communication tools as we move towards global sustainability.

There's also a non-narrated version, but I like the narration. It helps you better appreciate what you're seeing. Oh yeah, and ooohh, purdy.

[via infosthetics]

I've never played Minecraft, but maybe this map showing live server connections means something to those who do. "A dot is a server or a client. Lines are traced from clients connecting to servers. Lone dots are local servers." They also have raw hardware data available for download. [Thanks, Erik]

With the Titanic anniversary this year, Chiqui Esteban dug up graphics back from the time of the event. This one showing the time to cross the Atlantic is the best. "If only we could fly the Atlantic!"

With The Avengers coming out today in the US, artist Jer Thorp had a look at character appearances, of which there have been 127 since 1963.

We can see a big cluster of major Avengers appearing in the first few episodes, with some other big names coming in the next few years (Vision, the Avenger with the 3rd most appearances in issues, doesn't come along until #57). While there are a couple of major additions along the way (She-Hulk & Photon in 1982), we can see that the cast of characters for the team is defined pretty early.

See Thorp's post for additional categorizations such as gender balance and robot characters. Best enjoyed in high resolution.

I've been reading papers on how people learn statistics (and thoughts on teaching the subject) and came across the frequently-cited work of mathematical psychologists Amos Tversky and Daniel Kahneman. In 1972, they studied statistical misconceptions. It doesn't seem much has changed. Joan Garfield (1995) summarizes in How to Learn Statistics [pdf].
Continue Reading

A while back, Robert Kosara and Caroline Ziemkiewicz shared their work on Parallel Sets, a way to visually explore categorical data. Software developer, Jason Davies, just ported the technique to Data-Driven Documents (D3). The interactions for sorting and rearranging are similar to the Kosara and Ziemkiewicz version, but the D3 version of course runs in the browser and has some nifty transitions. Try toggling the show curves box and the icicle plot one.