For each sin we stretched our imagination to find a workable proxy--murder rates for wrath, per capita billionaires for avarice--then culled the available data sources to rank the cities. Some of the results were surprising: Salt Lake City as America's Vainest City. Some were not: Detroit as America's Most Murderous.
It's always good to remember to take these with a grain of salt, since you don't really know much about the metrics used and how useful these metrics really are. Usually, rankings like these involve a lot of assumptions about the data.
They are of course still interesting and fun to look at though. Apparently, I moved from one America's most gluttonous cities to one of the most violent and lustful.
Chris Harrison put together a series of Internet maps that show how cities are interconnected by router configuration. Similar to Aaron Koblin's Flight Patterns, Chris chose to map only the data, which makes an image that looks a lot like strands of silk stretched from city to city. With these maps, viewers gain a sense of connectivity in the world - and as expected the U.S. and Europe are a lot brighter than the rest. Continue Reading
I just created a new Twitter account, and it got me to thinking about all the data visualization I've seen for Twitter tweets. I felt like I'd seen a lot, and it turns out there are quite a few. Here they are grouped into four categories - network diagrams, maps, analytics, and abstract.
Twitter is a social network with friends (and strangers) linking up with each other and sharing tweets aplenty. These network diagrams attempt to show the relationships that exist among users.
Twitter Social Network Analysis
The ebiquity group did some cluster analysis and managed to group tweets by topic.
Twitter in Red
I'm not completely sure how to read this one. I looks like it starts from a single user and then shoots out into the network.
I thought this map was amusing. As you can see, Mr. Bridges prefers those in the southeast and northeast according to his 2001 hit single, Area Codes in which he raps about all the female friends he has made.
This is yet another example of the ubiquity of data. If you can find hoe data in Ludacris' Area Codes, you can find data anywhere. Here's the large version of the above map. By the way, I'm sorry if I've offended anyone with this hoe data. Hoe data.
New York Talk Exchange - Illustrates the global exchange of information in real time by visualizing volumes of long distance telephone and IP (Internet Protocol) data flowing between New York and cities around the world.
A Week In the Life - A data sculpture made out of cardboard representing movement and communication from a cell phone in one week to increase awareness of the German Telecommunications Data Retention Act.
National Gruntledness Index - A heat map showing where in the United States most people are, um, gruntled. Is this for real? Somehow I don't think the entire country is pissed off.
BreathingEarth is an animated map that represents death rate data from September 2005 and birth rate data from August 2006 compiled by the World Factbook and 2002 carbon dioxide emission rates from the United Nations. The frying sound is kind of a nice touch.
Pretty But Not Very Useful
I think that BreathingEarth, like manymapsbeforeit, communicates an important point (in this case, CO2 emissions), but doesn't particularly do a good job of showing it. I watched BreathingEarth for a few minutes, but I didn't get much of a sense of what country had more deaths, had more births, or created more CO2 emissions. It's one those projects when a statistician could have lent a useful hand.
So to answer the question - What Impact Does Our Country Have on Climate Change? - I'm not sure. It is a pretty map though.
Manhattan Timeformations looks like a series of interactive schematics from a video game, but really it's a computer model that allows you to look at the relationships between the developments of the lower Manhattan skyline and other urban factors like farms, urban renewal, subways, and commercial zones. The visualization provides different views in the form of the traditional 2-dimensional map views as well as rotations, fly-throughs, and layers.
It's nice to step out of that Google mashup look every once in a while.
There's a nice real-time (?) map on (suit)men Entertainment. Click the black rectangle on the bottom left-hand corner to see the entire map. Supposedly the map is powered by Google, so I want to say it's showing search data or something of that sort. To be honest though, I have no clue.
Whenever a number pops up, there's a line that connects some country to Japan (the site's origin), so I'm guessing they're mapping something like accesses to the (suit)men site from whatever country. Oh well, no matter. Look how pretty. It's entertainment, and it managed to entertain me for a good few minutes (which says alot with my short attention span :). Does anyone know what they're showing?
After two weeks at Visualizar, I'm back in the United States. It's good to be back. I don't know how many people know this (because I certainly didn't), but the people in Madrid (or all of Spain?) eat a ridiculous number of sandwiches. I spoke to a couple of locals who said it's pretty common to eat two sandwiches a day every day. I'm all sandwiched out.
Anyways, the Visualizar symposium / workshop was a lot of fun, really interesting, and I ended up learning a lot more than I expected from some incredibly talented people. During my two weeks, I had the opportunity to work with designers Miguel Cabanzo, Iman Moradi, and Monica Sanchez and we managed to build a visualization framework that shows migration data with economic indicators. We call the piece humanflows.
Human Flows, the Piece
I just tried putting humanflows online, but of course it's not working on my server right now (because all computers are against me), so I settled for a couple of screencasts. You'll just have to take my word for it that the whole thing came together really nicely with a kiosk-looking type setup and a designer's touch (three of them, actually). The visualization itself was done in Processing.
Here's the first one that just shows the flows. Right off bat, you can see the huge rush to the United States (especially immigrants from Mexico).
This one shows the flows with unemployment rate.
We also did one with GDP, but you get the idea.
Of course, now that we have a framework, there's so many other things that I can think of adding. Functionality like specific country selection and the ability to browse through other indicators would really allow some serious data exploration and since we were working with data form the United Nations Common Database, which has a hundreds of publicly available datasets, there's a lot to work with.
So there it is. Humanflows.
Through the development process, I learned a lot about what I can do with Processing as well as gained an entirely different perspective on data visualization -- a designer's perspective. Simple concepts like color and more complex ideas like how to approach a large dataset are some of the things that I learned that I think are important for statisticians and the more technically-involved data people to know. I'll cover that stuff in later posts though.
For now, I'd appreciate any comments on our visualization and any ideas on how to improve it. How would you visualize migration data?
I was about to click away, but then I saw movement on the map. In addition to recent incidents, the map also has police unit tracking. You can see where certain units are at any given time as well as a video feed. That's pretty cool. However, it doesn't seem live, because every car is Officer Heinz, every car shows the same video, and the timestamp on the video shows November 2004. I guess it's just a demo or prototype right now.
How cool would it be if that were live though? I can imagine plasma screens on the walls of every gang's central control station. Crime could be transformed forever.
Many Eyes now has more detailed mapping functionality with the help of ESRI data. It was really only a matter of time before this happened. It's come to the point where I almost instantly think ESRI when I think maps--that and The Times maps department (who frequently uses ESRI data :). Anyways, this is pretty nice looking stuff. They've got bubbles, color coding, and multiple maps in matrix form (to compare).
I didn't get a chance to look at the maps in depth, but one thing that I noticed is that the region bubbles are only labeled if they're at least a certain size. If they're smaller than that threshold, then it's just the bubble. I'm not sure what the threshold is, but I feel that it could be a bit lower so that more labeling can happen.
There's also (of course) zoom-in, zoom-out, and panning-- features we have come to expect from online mapping applications. Zoom and pan gets a little sluggish when there are multiple maps, but the feature still feels pretty useful.
While on the topic of maps here's a Microsoft Virtual Earth mashup -- US Demographics Visualizer. It allows the user to map US census data by county. Map population, age, ethnicity, election results, and income. It's not quite as responsive as the Competitive Edge Explorer, but if you're looking to explore country-wide census data, then it's worth taking a look at.
The Competitive Edge Explorer is a mapping project from the MIT Laboratory for Mobile Learning. It's not just some hodge podge Google Maps mashup. The Explorer was written in Processing and has an intuitive and responsive user interface. As the user switches through datasets or zooms in and out, the map changes instantly. A total of eight datasets, including education, income levels, and housing costs, are available and can be selected at the same time to compare different areas according to different variables. The Explorer is yet another example for how maps offer the user a familiar visualization (just like timelines) for data.
It would be especially cool if the Explorer was not just for Boston, but for the entire U.S. or even better, the world. Of course, finding that much data seems impossible now, but hey, it doesn't hurt to hope.
World Freedom Atlas is an online geo-visualization tool that shows a number of freedom indicators so to speak. For example, you can map by a number of indexes such as raw political rights score, civil liberties, political imprisonment, freedom of religion, freedom of speech, or torture. If I've counted correctly the data comes from 42 datasets divided into three categories:
What It Is
How To Get It
What You Get
What It Is covers data such as political rights and civil liberties while How To Get It is data on government structure and education system. I'm not really sure What You Get is though. There's GDP and some economic indexes, so it could be something like quality of life. Maybe someone can explain it better?
The mapping and plots are pretty standard, but what stands out is the number of datasets that have been formatted in such a way the user is able to map things quickly and easily. It would be really cool if the data was explained a little better, so that I could "browse" the data a bit more efficiently, and even better, if there were some way to compare indicators against each other. Nevertheless, worth exploring a bit.
I saw this map of the average snow levels in Buffalo. I think I just glanced at it and that was about it. When you first look at the map, what do you make of the colors? When I see green for snow levels, I think no snow. Am I crazy? What do you think?
So the image was kind of in my head all this summer while I was in NYC. When I told people that I was going back to Buffalo after my internship, they always gave this look that said, "Ha, have fun during the winter," and then they would actually say it and then go into how they measure the snow level by comparing it against a giant pole. Continue Reading
When I think airplanes and data visualization, I think of Aaron Koblin's Flight Patterns. Aaron uses data from the Federal Aviation Administration to show flights all across the United States, including Hawaii and Alaska. Even without the presence of an actual map, you can see a basic geography and where lots of flights are going and coming from. Flight Patterns is an oldie, but still a goodie. Here's a video:
Speaking of flights, I'm currently waiting for my twice-delayed flight back to Buffalo. Thank goodness for free WiFi. Although it still doesn't make up for the delays. I hereby shake my mental fist of rage at you, Jet Blue.
If you've read any books on visualization, without a doubt, you've seen John Snow's now famous cholera map. In 1854, people were dying in large numbers and high frequency, but nobody knew what was going on. John Snow solved the mystery with his map.
It's crazy to imagine a time when people didn't think to map data, especially now as mapping data has become second nature for some. Steven Johnson, author of Ghost Map, goes into depth on the Cholera outbreak in London in his book and TED talk earlier this year.
I'd embed it, but I can't find the link anywhere on the TED page. They probably had to make it less obvious after Hans Rosling's talk spread at the speed of Cholera in London in 1854. London hasn't had another outbreak since Snow's simple (for this day and age) but effective visualization.
Yes, more mapping. Map, map, map. amMap offers a Flash-based mapping tool that you can download and customize to your liking.
Ammap is an interactive flash map creation software. Use this tool to show locations of your offices, routes of your journeys, create your distributor map. Photos or illustrations can be used instead of maps, so you can make different presentations, e-learning tools and more.
There's some smooth browsing and zooming, and it's pretty sleek. Those who appreciate simplicity will appreciate amMap. Plus, it's free :) Continue Reading
As a representation of history over time and space, Maps of War does a pretty good job of displaying the information in the form Flash animations. It's quite simple really. The animation starts centuries back (e.g. 2000BC) and moves to geographic regions. In the above map, I watched who has controlled the middle east, beginning 3000BC up through 2006.
Twittervision is a Google Maps mashup using the Twitter RSS feed. As people post to Twitter, you see the map move from location to location all around the world. It's really simple, but there's something entertaining about it that I can't quite put my finger on. Maybe we just like to peak into other people's lives. Anyways, I don't know how recent this is, but Twittervision now has a third dimension which is equally as entertaining as the original.