• Responsive maps with D3.js

    October 18, 2013  |  Software

    Responsive maps

    A challenge these days with visualization is that a piece might look great on a computer monitor and then break on a tablet or phone. However, if you design your software with that in mind so that it adapts to the device it's on — so that it's responsive — your audience loves you more for it. Chris Amico explains how to get started in D3.js: responsive maps, charts, and legends.

  • R plotting package ggplot2 ported to Python

    October 16, 2013  |  Software

    ggplot2 ported to Python

    Those who use the ggplot2 package in R and do everything else in Python will appreciate this Python port of the package from yhat.

    Excel makes some great looking plots, but I wouldn't be the first to say that creating charts in Excel involves a lot of manual work. Data is messy, and exploring it requires considerable effort to clean it up, transform it, and rearrange it from one format to another. R and Python make these tasks easier, allowing you to visually inspect data in several ways quickly and without tons of effort.

    The preeminent graphics packages for R and Python are ggplot2 and matplotlib respectively. Both are feature-rich, well maintained, and highly capable. Now, I've always been a ggplot2 guy for graphics, but I'm a Python guy for everything else. As a result, I'm constantly toggling between the two languages which can become rather tedious.

    Once you get the Python library installed (and its dependencies), you'll be able to use the same layered graphics approach as the R package, with a similar syntax.

  • Raw, a tool to turn spreadsheets to vector graphics

    October 8, 2013  |  Online Applications

    Sometimes it can be a challenge to produce data graphics in vector format, which is useful for high-resolution prints. Raw, an alpha-version tool by Density Design, helps make the process smoother.

    Primarily conceived as a tool for designers and vis geeks, Raw aims at providing a missing link between spreadsheet applications (e.g. Microsoft Excel, Apple Numbers, OpenRefine) and vector graphics editors (e.g. Adobe Illustrator, Inkscape, Sketch). In this sense, it is not intended to be a full “visualization tool” like Tableau or other similar products: as the name suggests it is a sketch tool, useful for quick and preliminary data explorations as well as for generating editable visualizations.

    Although still in its early stages, Raw is actually quite useable. Start with a dataset copy and pasted from your spreadsheet, select a visualization format, and then click-and-drag how you want to represent values. Modify options as you see fit and download in the format you need.

  • Easier Census data browsing with CensusReporter

    September 17, 2013  |  Online Applications


    Census data can be interesting and super informative, but getting the data out of the dreaded American FactFinder is often a pain, especially if you don't know the exact table you want. (This is typically the case.) CensusReporter, currently in beta, tries to make the process easier.

    CensusReporter is a Knight News Challenge-funded project to make it easy for journalists to write stories using U.S. Census data. Expanding upon the volunteer-built Census.ire.org, Census Reporter will simplify finding and using data from the decennial census and the American Community Survey. The goal of the new site is to include much more data, to provide a friendlier interface for navigating all of that data, and, as much as possible, to use visualizations to provide a more useful first look at the data.

    Although the application is still a work-in-progress, it's usable and clearly on its way to an improvement over the painful default. The CensusReporter is faster, easier to use, and the graphics provide a visual summary that helps you decide if the current table is actually what you want.

  • Excel paintings

    September 16, 2013  |  Software

    Excel paintings

    Tatsuo Horiuchi wanted to learn something new before retiring, so he bought a computer and booted up Microsoft Excel. Traditional graphics software from companies like Adobe were too expensive. Hariuchi's beautiful results look like nothing you normally see come out of the spreadsheet software.

    People like to knock Excel or <insert software program here> as if it's the leading cause of their challenges with data. Then you come across something like this. Maybe it's not the easiest way to go about making something, but if you can draw based on data, you've got yourself a way to visualize data. Maybe the software isn't your problem. [via ReadWrite]

  • Introduction to R, a video series by Google

    August 13, 2013  |  Software

    Google released a 21-part short video series that introduces R. Most of the videos are about two minutes, with none of them going over six, and each one is a on focused task or concept. So this could be a good way to start. Just open R, start a video, and follow along.

    Here's the first video in the series. It shows you how to write a simple script and navigate:

    [via Revolutions]

  • Beer Mapper: An experimental app to find the right beer for you

    April 30, 2013  |  Software

    Beer map

    Kevin Jamieson, an electrical and computer engineering graduate student at the University of Wisconsin-Madison, put his work in active ranking into practice. The experimental app is called Beer Mapper.

    The application presents a pair of beers, one pair at a time, from a list of beers that you have indicated you know or have access to and then asks you to select which one you prefer. After you have provided a number of answers, the application shows you a heat map of your preferences over the "beer space."

    Around 10,000 beers with at least 50 reviews on RateBeer were used as the foundation of the recommendation system. The reviews were reduced to just the individual words and counts, which gives sort of a profile for each beer (or a "weighted bag of words"). You rate beers, and the system tries to find profiles that are mathematically most similar.

    Two caveats. The first is that it looks like the app just gives you a heat map of the styles of beer you might like. A recommended list of actual beers would be way better. Second, the app is a research project that likely won't be in the app store any time soon, so the first point is moot. Sad face. Maybe Untappd should read Jamieson's paper. [via Fast Company]

  • Binify for hexagon binning in Python

    April 25, 2013  |  Software

    Hexagon binning

    As an alternative to dot density maps, Binify by Kevin Schaul allows you to map with hexagon binning in Python.

    Dot density maps are a straightforward way to visualize location data, but when you have too many locations, points can overlap and obscur clusters and trends. That's where binning comes in. Generally speaking, the goal is to look at an area on a map and then count how many points are within that area. Do that across the entire area.

    Grab the package on GitHub and go to town.

  • Vega: A visualization grammar to create without programming

    April 2, 2013  |  Software

    Population with Vega

    Visualization online can be a challenge if you don't know how to program. Analytics startup Trifacta just lightened the load with Vega, a "visualization grammar" that lets you create and share by editing a JSON file. Check out the demo live editor to see how this works. Select different chart types from the drop down menu on the top left, which you can render in HTML5 Canvas or SVG.

    Of note: Vega is built on top of Data-Driven Documents.

    To get right to the point: Vega is NOT intended as a "replacement" for D3. D3 is intentionally a low-level system. During the early design of D3, we even referred to it as a "visualization kernel" rather than a "toolkit" or "framework". In addition to custom design, D3 is intended as a supporting layer for higher-level visualization tools. Vega is one such tool, and leverages D3 heavily within its implementation.

    Gonna keep an eye on this one.

  • Forecast: A weather site that’s easier to read

    March 27, 2013  |  Online Applications


    When you go to one of the major sites to look up the weather, it's often hard to find what you're looking for. The sites feel dated, there isn't much hierarchy to the information, and navigation gets buried in the show-as-much-information-as-possible-on-the-same-page approach. Forecast, a site by the makers of the Dark Sky app, hopes to improve that experience during those times you need more than the high and lows for the day from the nearest widget.

    When you visit Forecast, you notice a difference right away. There's a map with local, regional, and global views, the temperature in large print on the right, and there are descriptions about what to expect that are easy to understand.

    From there, you get your daily forecasts below the map with details on demand. So you can get a lot of the same information that you get from larger sites, but you don't get hit with a bunch of data at once, and when you request more information, you get it quickly.

    There's also an API. Forecast and the Dark Sky app both run on it, which is the cherry on top of the goodness.

    I usually go to Matthew Ericson's minimalist weather page when I'm figuring out when to ride my bike or mow the lawn. Forecast might be my new weather destination for a while.

  • Learn about politics in your state with Open States

    February 26, 2013  |  Online Applications

    Open States

    It's not especially straightforward to know or find out what's going on with your state's government. Sites aren't maintained, are unusable, or just don't provide much information. Open States, a project by the Sunlight Foundation, aims to change that.

    After more than four years of work from volunteers and a full-time team here at Sunlight we're immensely proud to launch the full Open States site with searchable legislative data for all 50 states, D.C. and Puerto Rico. Open States is the only comprehensive database of activities from all state capitols that makes it easy to find your state lawmaker, review their votes, search for legislation, track bills and much more.

    Just click on a state or enter an address, and you can quickly get information that's relevant to where you are. There's also iPhone and iPad apps if you prefer those, and all the data on the site is accessible via an API or a bulk data dump.
    Continue Reading

  • Sitegeist: A mobile app that tells you about your data surroundings

    December 14, 2012  |  Software

    From businesses to demographics, there's data for just about anywhere you are. Sitegeist, a mobile application by the Sunlight Foundation, puts the sources into perspective.

    Sitegeist is a mobile application that helps you to learn more about your surroundings in seconds. Drawing on publicly available information, the app presents solid data in a simple at-a-glance format to help you tap into the pulse of your location. From demographics about people and housing to the latest popular spots or weather, Sitegeist presents localized information visually so you can get back to enjoying the neighborhood. The application draws on free APIs such as the U.S. Census, Yelp! and others to showcase what's possible with access to data.

    Available for free on both Android and iPhone. Data just a flick and a scroll away. [Thanks, Nicko]

  • Shiny allows web applications with R

    November 13, 2012  |  Software

    Shiny for R

    RStudio, the folks behind the IDE for R released last year, continues to expand their offerings for current and future R users. Shiny is RStudio's most recent release, and it aims to make R web applications easier to make and share.

    The main advantage is that you can create user interfaces that show R output, without HTML and JavaScript. There are essentially two parts to each app that you write: the client and the server. You load the Shiny package, create a client and server, and you're off to the races.

    However, don't get too excited about R on the Web yet. The apps are meant to run locally, so to share an application with someone, you have to send them the code for them to run on their own. RStudio is working on a paid service that lets you host your apps online. Or, because Shiny is open source, you can try running it on your own, if you like.

  • xkcd-style charts in R, JavaScript, and Python

    October 19, 2012  |  Software

    xkcd-style plots

    The ports and packages to make your charts look like they came from the web comic xkcd are coming out in rapid fashion. Dan Foreman-Mackey stylized charts in JavaScript using D3, Mark Bulling did the same in R, and Jake Vanderplas described how he did in Python. Still waiting for a Gangnam theme.

  • Torque for mapping temporal data

    October 2, 2012  |  Software

    Torque example

    Mapping data over time can be challenging, especially when you have a lot of data to load in the beginning. Torque, the new open source project by CartoDB, is a step towards making the process easier.

    Torque allows you to create beautiful visualizations with big temporal datasets by bundling HTML5 browser rendering technologies with a generic and efficient temporal data transfer format created using the CartoDB SQL API. Torque visualisations work on desktop and ipads, and work well on temporal datasets with hundreds of thousands or even millions of datapoints.

    It's still in the early stages but should be one to keep an eye on.

    Check out this map for a sense of what Torque can help you do. The map animates historical edits to OpenStreetMap in Madrid. Also this. [Thanks, Carlos]

  • Easy and customizable maps with TileMill

    September 21, 2012  |  Software

    Map with TileMill

    I'm late to this party. TileMill, by mapping platform MapBox, is open source software that lets you quickly and easily create and edit maps. It's available for OS X, Windows, and Ubuntu. Just download and install the program, and then load a shapefile for your point of interest.

    For those unfamiliar with shapefiles, it's a file format that describes geospatial data, such as polygons (e.g. countries), lines (e.g. roads), and points (e.g. landmarks), and they're pretty easy to find these days. For example, you can download detailed shapefiles for roads, bodies of water, and blocks in the United States from the Census Bureau in just a few clicks.

    The fun part is that you can easily customize the maps using a map stylesheet, which is similar to CSS. There are examples with the software, so you can get a feel for how everything fits together. You can also export your results as an image file or as SVG to edit in your favorite vector-editing software. Or if you want to publish your map online, it's straightforward to upload it to MapBox with an account.

  • Analyze your Facebook profile with Wolfram|Alpha

    September 3, 2012  |  Online Applications

    Facebook Wolfram Alpha

    Feeding off the momentum from Stephen Wolfram's personal analytics earlier this year, Wolfram|Alpha launched Facebook Analytics, which spits out graphs about your profile and your friends. You can see your activity over time, weekly distributions, and some general information about how people like and comment your status updates.

    I've only updated my Facebook status a few times this year, so the profile-focused information is interesting to me, but the second half of the report provides high-level aggregates about your friends. For example, I'm apparently at a stage in life where most of my friends are either married or in a relationship. You can also see how your friends are connected via a network graph.

    So you get more detail than you do out of current infographic-generators. The hook though is the links within the report that lead to information about your birthday or where you were born, kind of like when you end up reading about sasquatch on Wikipedia when your original search was actually work-related.

  • Resources for Getting Started with R

    June 4, 2012  |  Software

    R, the open source statistical software environment, is powerful but can be a challenge to approach for beginners. For me, the best way to learn R, especially on the visualization side of things, is to dive right in. Grab some data and make some charts, or better yet, find a graph you like and try to replicate it.

    R core functionality and the many available packages let you do a lot without having to know what's going on underneath. I use this approach in Visualize This and the tutorials around here. I like the satisfaction of immediate results. Then I learn the nitty gritty later.

    That said, it doesn't hurt to familiarize yourself with the environment. Also, visualization is a small part of what you can do with R, so it can help to know what else you can do analysis-wise.
    Continue Reading

  • New open data platform launches

    May 29, 2012  |  Software  |  Kim Rees

    Junar Open Data Platform

    Open data is everywhere. However, open data initiatives often manifest as mere CSV dumps on a forlorn web page. Junar, Lunfardo (Argentina slang) for "to know" or "to view," seeks to help government and organizations take the guesswork out of developing their own software for such efforts.

    Their open data platform allows organizations to collect and select their data, publish it, create reports and dashboards, and share their data online. The solution can be hosted or integrated into the organization's website, and the data can be made open or for internal use only. End users can "follow" live data on the site, download it, or embed it. There's also a built in API, so the organization doesn't have to develop one of their own.

    Junar looks like it's ready to fill the gap in open data publishing with its soup to nuts approach. With lots of great features and an easy to use interface, it seems like a welcome change to the alternatives.

  • More infographic software

    May 25, 2012  |  Online Applications  |  Kim Rees


    Recently there's been a spate of infographic tools popping up (e.g., easel.ly, venngage, and infogr.am). Okay, I'm not sure if 3 qualifies as a spate, but it sure seemed like a lot in a short period of time. I gave Infogr.am a whirl, and it appears to be the front runner in terms of capabilities. Unlike easel.ly, you can *actually input data* into your infographic! What a novel concept. Venngage was hit and miss in terms of it accepting the data I entered. Infogr.am also has a bug in that you can't have the number 0 in your data. Go figure.
    Continue Reading

Copyright © 2007-2014 FlowingData. All rights reserved. Hosted by Linode.