Graphwise launched a few weeks ago, but I’m just hearing about it now, so I guess there hasn’t been a whole lot of buzz about this new application.

The Graphwise group has got a spider crawling the Web for data in HTML data tables and as a result, has accumulated a pretty big data warehouse. There’s currently 2,766,560 extracted tables in the Graphwise database. That’s pretty good, and I think they’re building on a pretty good idea. However, Graphwise advertises itself as three pieces of a three-piece puzzle — get data, visualize, and share.

To say the least, the visualize and share portions need work. Here’s a visualization from the front page:

I…I…don’t know what to say. Why the 3-d bars with the gradient background and the giant, semi-transparent Earth in the foreground blocking everything? It makes me want to throw up. It seriously looks like someone threw up data on the screen — data vomit. The javascript-enabled graphs seem to be making the browsing experience pretty sluggish too.

Am I being too harsh? My conscious is yelling at me for calling the graphs regurgitated food.

OK, OK. So to sum things up — the data warehousing and Web crawling are great. The spiders are clearly doing their job, so thumbs up for that. As for the visualizations, I, well, uh, it needs work (along with all the other junk that comes with running these types of data-centric applications).

[via Swivel]

When I talk about data, people often zone out or don’t really see the interest. Why does this happen? People just don’t understand the wonder that is data and how much of their life is led by data. With that in mind, why would people share their data? You can’t share something you don’t know exists. Off the top of my head, here’s 100 reasons to be interested in, want to share, and get excited about data.
Read More

While on the topic of maps here’s a Microsoft Virtual Earth mashup — US Demographics Visualizer. It allows the user to map US census data by county. Map population, age, ethnicity, election results, and income. It’s not quite as responsive as the Competitive Edge Explorer, but if you’re looking to explore country-wide census data, then it’s worth taking a look at.

I have not yet achieved that elusive zero-byte graphics program, but I do believe that bulk, in programming or in writing, can sometimes be an inverse measure of clarity and thought. Users dislike “bloatware” not only because it is a pig that wastes their computers’ resources but also because they know it usually reflects design-by-committee and sloppy thinking.

Leland Wilkinson. The Grammar of Graphics. 2005.

GOOD Magazine is really growing on me. Have you subscribed yet? All of your subscription costs go to the charity of your choice, and by all, I mean 100%. My subscription money went to Ashoka.

In their most recent awareness animation, GOOD Magazine takes you inside the business of death.

Throughout the developed world the business surrounding death has often been an uneasy topic of discussion. Originating in the mid-19th Century, the modern funeral has evolved into an economic and cultural monster, with a vast network of supporting industries and myriad options for your earthly remains.

The amount of money put into casket, tombstone, plot etc. is kind of frightening. As if a death in the family isn’t troubling enough.

Eyebeam, an art and technology research center, has posted two eco-viz challenges to get artists and technologists thinking about data visualization and the role it plays in raising environmental awareness. The first challenge is to create an eco-icon that signals something about the environment. It might be displayed as a sign or on a cell phone. The second challenge is to create an eco-viz that focuses on a data set and displays the data in a novel way.

This is exactly why eco-viz has become so important. Consumers (myself included) don’t know how they’re wasting resources and the effect they’re having on the environment. All consumers know is that the longer they leave the lights on or the higher they turn up the heat, the more money they have to pay at the end of the month. If consumers are consistently wasteful, then a high bill won’t seem that unusual. A few more dollars per month isn’t enough to get someone to turn the thermostat down a few degrees.

As Peter B. Crabb put it in Control of Energy-depleting Behavior (1992)

[P]eople do not use energy; they use devices and products. How devices and products are designed determines how we use them, which in turn determines rates of energy depletion.

The deadline for the eco-icon challenge is coming up soon — November 5. There’s more time until the eco-viz deadline — December 8.

[via EcoViz]

Despite being surrounded with ads, this money clock was kind of, um, interesting. Put in how much you earn hourly, monthly, or annually, and it displays a running clock of dollars and cents for how much you’ve earned while watching the clock. It was amusing at first, and then kind of depressing after a few seconds.

P.S. Happy Halloween!

Tom from Stamen Design and Hadley from the GGobi group kindly pointed me to the recently ported Flare visualization toolkit. Developed by Berkeley’s Jeffrey Heer, Flare looks extremely useful for anyone who is interested in developing interactive visualizations (e.g. time series, stacked bar, pie charts, graph) for the Web that run in the Adobe Flash player.

There’s a pretty good tutorial that I, as a beginner, found straightforward. I ran into some problems when I was trying to “import a library into another project,” but per Jeffrey’s suggestion, I upgraded to Adobe Flex 3 beta (currently a free download). That cured my problems. Adobe Flex is apparently still a little rough around the edges. Oh right, and the tutorial provides instructions on how to develop with Flare in the Flex Builder environment.

I’m currently going through the demos to gain a better understanding of both Flare and Actionscript, and it looks very promising. I’m pretty excited about what I can do once I’ve improved my Actionscript programming skills.

Check out some screenshots from the Flare demo reel after the jump.

Read More

On Last.fm, someone took snapshots of some Linkin Park songs, compared them, and concluded that all Linkin Park songs look are the same. I guess at a glance, the songs might appear the same because of the dark chunk towards middle left, but it kind of stops there. Sure, there’s some loud to soft and soft to loud alternation, but who likes songs who are loud (or soft) throughout?

The beginning of the post:

Each image above shows the audio level in (roughly) the first 90 seconds of a Linkin Park song. The tempo has been adjusted for a few tracks for better visual alignment.

Wait a minute. The tempo was adjusted for better visual alignment? If you’re adjusting the tempo, then really, all songs can be made to look the same. On top of that, we don’t know the x-axis or y-axis units. Finally, there’s a lot more to a song other than dynamics — such as key, tempo, rhythm, and lyrics.

Read More

The Competitive Edge Explorer is a mapping project from the MIT Laboratory for Mobile Learning. It’s not just some hodge podge Google Maps mashup. The Explorer was written in Processing and has an intuitive and responsive user interface. As the user switches through datasets or zooms in and out, the map changes instantly. A total of eight datasets, including education, income levels, and housing costs, are available and can be selected at the same time to compare different areas according to different variables. The Explorer is yet another example for how maps offer the user a familiar visualization (just like timelines) for data.

It would be especially cool if the Explorer was not just for Boston, but for the entire U.S. or even better, the world. Of course, finding that much data seems impossible now, but hey, it doesn’t hurt to hope.

Part of the AIM network, it’s another online application to create and share timelines. As I’ve said before, timelines are very intuitive in displaying both data and information, so it’s not surprising that these applications are springing up. The circaVie user interface feels a bit easier than xtimeline, and I like circaVie’s style and design a lot more too. In particular I like the timeline scrolling; it feels a lot like the iPhone interface. Try it out for yourself using your AIM screenname.

I just found this in my draft folder from a while back. It’s kind of old news, but I think it’s still worth mentioning.

Gun control advocates failed to gain local government and law enforcement agencies’ access to gun sales data.

The House Appropriations Committee defeated two attempts by gun control advocates to strip four-year-old restrictions on the use of information from Bureau of Alcohol, Tobacco, Firearms and Explosives tracing gun sales. The votes were a victory for the National Rifle Association and came despite the Democratic takeover of Congress in January.

One side argues that gun sales data will help law enforcement agencies track gun dealers who sell guns illegally. The other side argues that there’s privacy at stake, and there’s a chance that police officers’ identities could be inferred. A big victory for gun rights advocates, or so the the article might suggest.

My opinion — even if gun sales data were given to law enforcement, how could anyone guarantee data integrity? I think it’s fair to say that dealers selling guns illegally aren’t going to provide accurate reports. Sell a gun under the table with cash, don’t report it, and the data doesn’t reveal much. Am I missing something here?

I thought Robert was just thinking out loud when he wrote his post on World Visualization Day, but I was apparently wrong. There’s now a simple World Visualization Day site, a World Visualization Day Facebook group, and a first pass at a logo.

World Visualization Day aims to take visualization out of the ivory tower of academia and bring it to the people. On one day of the year (which still needs to be decided), there will be events throughout the world for the general public to become aware of the power and usefulness of visualization, and to learn how to use it.

I think this is an excellent idea. Nobody outside of the field seems to have a clue about what visualization is. It’s always funny to talk to my mom about what I do. Despite all the nodding and mm hmm-ing, I know it’s all completely over her head.

It gets even worse when I start talking to people about Statistics. The eyes glaze over, and I just know they’re not even listening. Nobody seems to know what Statistics is outside of sports figures and standard deviation. “If I were doing what you were doing, I’d be a sports statistician.” Sure that’d be cool, but you know, there’s more to Statistics than the number of touchdowns Randy Moss has scored this season (It’s 10 by the way. He’s my top fantasy football player :).

What about a World Statistics Day?

I’m tempted to ask for a World Statistics Day, but what would that even involve? A bunch of results from analyses? Theory? Algorithms? It would probably end up looking a lot like a World Visualization Day. Statistics results always seem to be more compelling when accompanied by some sexy visualization.

Nevermind. I’m getting off-topic. So yeah, World Visualization Day, check it out. It’d be fun to see all of the world’s top information and data visualists (?) putting together pieces to show everyone what visualization really is.

Are bubble charts effective? This seems to be a recurring question. Some say people suck at comparing areas in the form of bubbles, or rather, people are horrible with areas, period. Others argue that it just takes some getting used to; the eye has to be trained, and once that’s done, the bubbles are good to go.

In any case, here is an alternative to the bubbles — bars. The beer data from a previous post are charted (2006 shipments on the left, and 2005 shipments on the right). The advantage of bars over bubbles is that users only have to compare heights; however, numbers are going to clutter quickly as more observations are added.

People should just train their eyes. Bubbles are so much more fun. They’re bubbly.

Maybe someone can help me with this. I’m shifting focus from static graphics (with Adobe Illustrator) and moving onto dynamic data visualization with Flash and Actionscript. Does anyone have any book or site suggestions that you’ve found particularly helpful in data visualization?

I have three books sitting in front of me right now:

1. Hands-on Training for Macromedia Flash Professional 8 from Lynda
2. Essential Actionscript 2.0 from O’Reilly
3. Macromedia Flash 8 @work from Sams

I started going through Essential, and I’ve clearly forgotten what a chore it is to learn a new programming language in the early beginnings. To read books about code is particularly boring to me. Although I suppose it’s necessary. I’ve also read a lot of the Hands-on book, which wasn’t exactly my cup of tea either. Going through the tutorials reminded me a lot of the ArcGIS crash course I took earlier this year. “Click this to do that, and click that to do this. Click this and that to do that and this. After you’re done, voila. You get this…and that.”

For an idea of what I can do already: I mainly have R, PHP, and some Processing behind me, and then there’s the computer science courses I took in undergrad at Berkeley, which I guess has been about four years ago now.

So if anyone has any ideas or suggestions on what books to read, online resources to check out, or aspects of Actionscript and/or Flash I should focus on, please, I am all ears.

GOOD Magazine is “media for people who give a damn.”

While so much of today’s media is taking up our space, dumbing us down, and impeding our productivity, GOOD exists to add value. Through a print magazine, feature and documentary films, original multimedia content and local events, GOOD is providing a platform for the ideas, people, and businesses that are driving change in the world.

My favorite part of the magazine is the transparency section, which is a series of graphics displaying data in one way or another. The graphic (or video, I guess) above shows what companies are paying to advertise in New York City. The Walmart graphic I talked about earlier is in the most recent GOOD.

What if…

What if instead of just a section, there was an entire magazine that was a transparency section? Now that would be awesome. It could be a mix of the media & design in GOOD with some real statistical graphics. It would be a complete visual experience with of course a short blurb on each, but the magazine would focus on the graphics to inspire change and improve awareness. (Picture good. Words…. baaaad.)

Each issue would hover around a specific theme like the environment or economics; or even better, each issue could be more specific covering U.S. pollution or the decline of toy sales. I wonder how hard it would be to start something like that. Online first, print second? Is there a magazine already like this? If there isn’t, there needs to be.

Icastic has a fun (and growing) collection of (currently) 247 hand-drawings from contributors who have shown how they see time. Some are very detailed works of art while others are concise sketches. From words, objects, to people, the collection is a nice spectrum of imagination.

We look up at the starry sky and we sense a fear of not comprehending and being engulfed, a fear of the unknown, and simultaneously we experience a longing for the inaccessible, impenetrable darkness.

— Lisa Jevbratt. The Prospect of the Sublime in Data Visualization. 2004.

Speaking of Walmart, if we took all of the Walmarts in the world and clumped them all together, they’d cover Manhattan (with some stores sinking in the water). Walmart is the bottom bubbles; McDonald’s is represented by the second from the bottom set.

I’m slightly surprised that McDonald’s doesn’t cover more. Although, I guess Walmart stores are pretty big compared to McDonald’s restaurants. I’m not really surprised that Walmart area is greater than Manhattan area though. In fact, I thought it would have been more with all the Walmarts in the world. Hmmm…

Into the Artistic Section

As for this graphic, well, if it were supposed to be statistical, I’d say I didn’t I like it. It’s not meant to be statistical though. The goal is to show that Walmart is humungo. I get the graphic’s main point, which is… the point. To that end, I couldn’t care less about proper scales, utility, and what not. Take it for what it is and enjoy.

This Walmart graphic goes in the artistic section of viz, opposed to the pragmatic side (as Robert explains). There are three other graphics similar in feel to this one that cover sugar consumption, student debt, and solar power.

Technology Innovations in Statistics Education (TISE) is a new e-journal that was just announced yesterday. The use of technology (e.g. data visualization) has become extremely important in teaching statistical concepts to newbies, and so this new journal will be really useful; computers have allowed students to explore and experiment in ways students couldn’t do with just paper and pencil. TISE explores these alternatives.

Technology Innovations in Statistics Education (TISE) publishes scholarhip on the intersection between technology and statistics education. The current issue includes papers by George Cobb (who challenges the introductory statistics curriculum to radically innovate to adapt to new technology), Beth Chance et. al, (who provide an overview of the use of technology to improve student learning), Wlliam Finzer, et.al, (who describe software innovations for improving student access to data), Dani Ben-Zvi, (preliminary research results on using Wiki in statistics teaching), Daniel Kaplan (on the role of computation in introductory statistics), and Andee Rubin (an historical overview of technology in statistics education.)

These papers can be read at http://tise.stat.ucla.edu. Please click on the “subscribe button” to join the mailing list to be informed of future released.

TISE is seeking scholarly papers for Volume 2 that address any of these themes:

• Designing technology to improve statistics education
• Using technology to develop conceptual understanding
• Teaching the use of technology to gain insight into and access to data

The first issue is already online. Take a look. I’ve had the opportunity to work with some of the knowledgeable and active members of the editorial board, so TISE looks to be very promising.