• Excel paintings

    September 16, 2013  |  Software

    Excel paintings

    Tatsuo Horiuchi wanted to learn something new before retiring, so he bought a computer and booted up Microsoft Excel. Traditional graphics software from companies like Adobe were too expensive. Hariuchi's beautiful results look like nothing you normally see come out of the spreadsheet software.

    People like to knock Excel or <insert software program here> as if it's the leading cause of their challenges with data. Then you come across something like this. Maybe it's not the easiest way to go about making something, but if you can draw based on data, you've got yourself a way to visualize data. Maybe the software isn't your problem. [via ReadWrite]

  • Introduction to R, a video series by Google

    August 13, 2013  |  Software

    Google released a 21-part short video series that introduces R. Most of the videos are about two minutes, with none of them going over six, and each one is a on focused task or concept. So this could be a good way to start. Just open R, start a video, and follow along.

    Here's the first video in the series. It shows you how to write a simple script and navigate:

    [via Revolutions]

  • Beer Mapper: An experimental app to find the right beer for you

    April 30, 2013  |  Software

    Beer map

    Kevin Jamieson, an electrical and computer engineering graduate student at the University of Wisconsin-Madison, put his work in active ranking into practice. The experimental app is called Beer Mapper.

    The application presents a pair of beers, one pair at a time, from a list of beers that you have indicated you know or have access to and then asks you to select which one you prefer. After you have provided a number of answers, the application shows you a heat map of your preferences over the "beer space."

    Around 10,000 beers with at least 50 reviews on RateBeer were used as the foundation of the recommendation system. The reviews were reduced to just the individual words and counts, which gives sort of a profile for each beer (or a "weighted bag of words"). You rate beers, and the system tries to find profiles that are mathematically most similar.

    Two caveats. The first is that it looks like the app just gives you a heat map of the styles of beer you might like. A recommended list of actual beers would be way better. Second, the app is a research project that likely won't be in the app store any time soon, so the first point is moot. Sad face. Maybe Untappd should read Jamieson's paper. [via Fast Company]

  • Binify for hexagon binning in Python

    April 25, 2013  |  Software

    Hexagon binning

    As an alternative to dot density maps, Binify by Kevin Schaul allows you to map with hexagon binning in Python.

    Dot density maps are a straightforward way to visualize location data, but when you have too many locations, points can overlap and obscur clusters and trends. That's where binning comes in. Generally speaking, the goal is to look at an area on a map and then count how many points are within that area. Do that across the entire area.

    Grab the package on GitHub and go to town.

  • Vega: A visualization grammar to create without programming

    April 2, 2013  |  Software

    Population with Vega

    Visualization online can be a challenge if you don't know how to program. Analytics startup Trifacta just lightened the load with Vega, a "visualization grammar" that lets you create and share by editing a JSON file. Check out the demo live editor to see how this works. Select different chart types from the drop down menu on the top left, which you can render in HTML5 Canvas or SVG.

    Of note: Vega is built on top of Data-Driven Documents.

    To get right to the point: Vega is NOT intended as a "replacement" for D3. D3 is intentionally a low-level system. During the early design of D3, we even referred to it as a "visualization kernel" rather than a "toolkit" or "framework". In addition to custom design, D3 is intended as a supporting layer for higher-level visualization tools. Vega is one such tool, and leverages D3 heavily within its implementation.

    Gonna keep an eye on this one.

  • Forecast: A weather site that’s easier to read

    March 27, 2013  |  Online Applications

    Forecast

    When you go to one of the major sites to look up the weather, it's often hard to find what you're looking for. The sites feel dated, there isn't much hierarchy to the information, and navigation gets buried in the show-as-much-information-as-possible-on-the-same-page approach. Forecast, a site by the makers of the Dark Sky app, hopes to improve that experience during those times you need more than the high and lows for the day from the nearest widget.

    When you visit Forecast, you notice a difference right away. There's a map with local, regional, and global views, the temperature in large print on the right, and there are descriptions about what to expect that are easy to understand.

    From there, you get your daily forecasts below the map with details on demand. So you can get a lot of the same information that you get from larger sites, but you don't get hit with a bunch of data at once, and when you request more information, you get it quickly.

    There's also an API. Forecast and the Dark Sky app both run on it, which is the cherry on top of the goodness.

    I usually go to Matthew Ericson's minimalist weather page when I'm figuring out when to ride my bike or mow the lawn. Forecast might be my new weather destination for a while.

  • Learn about politics in your state with Open States

    February 26, 2013  |  Online Applications

    Open States

    It's not especially straightforward to know or find out what's going on with your state's government. Sites aren't maintained, are unusable, or just don't provide much information. Open States, a project by the Sunlight Foundation, aims to change that.

    After more than four years of work from volunteers and a full-time team here at Sunlight we're immensely proud to launch the full Open States site with searchable legislative data for all 50 states, D.C. and Puerto Rico. Open States is the only comprehensive database of activities from all state capitols that makes it easy to find your state lawmaker, review their votes, search for legislation, track bills and much more.

    Just click on a state or enter an address, and you can quickly get information that's relevant to where you are. There's also iPhone and iPad apps if you prefer those, and all the data on the site is accessible via an API or a bulk data dump.
    Continue Reading

  • Sitegeist: A mobile app that tells you about your data surroundings

    December 14, 2012  |  Software

    From businesses to demographics, there's data for just about anywhere you are. Sitegeist, a mobile application by the Sunlight Foundation, puts the sources into perspective.

    Sitegeist is a mobile application that helps you to learn more about your surroundings in seconds. Drawing on publicly available information, the app presents solid data in a simple at-a-glance format to help you tap into the pulse of your location. From demographics about people and housing to the latest popular spots or weather, Sitegeist presents localized information visually so you can get back to enjoying the neighborhood. The application draws on free APIs such as the U.S. Census, Yelp! and others to showcase what's possible with access to data.

    Available for free on both Android and iPhone. Data just a flick and a scroll away. [Thanks, Nicko]

  • Shiny allows web applications with R

    November 13, 2012  |  Software

    Shiny for R

    RStudio, the folks behind the IDE for R released last year, continues to expand their offerings for current and future R users. Shiny is RStudio's most recent release, and it aims to make R web applications easier to make and share.

    The main advantage is that you can create user interfaces that show R output, without HTML and JavaScript. There are essentially two parts to each app that you write: the client and the server. You load the Shiny package, create a client and server, and you're off to the races.

    However, don't get too excited about R on the Web yet. The apps are meant to run locally, so to share an application with someone, you have to send them the code for them to run on their own. RStudio is working on a paid service that lets you host your apps online. Or, because Shiny is open source, you can try running it on your own, if you like.

  • xkcd-style charts in R, JavaScript, and Python

    October 19, 2012  |  Software

    xkcd-style plots

    The ports and packages to make your charts look like they came from the web comic xkcd are coming out in rapid fashion. Dan Foreman-Mackey stylized charts in JavaScript using D3, Mark Bulling did the same in R, and Jake Vanderplas described how he did in Python. Still waiting for a Gangnam theme.

  • Torque for mapping temporal data

    October 2, 2012  |  Software

    Torque example

    Mapping data over time can be challenging, especially when you have a lot of data to load in the beginning. Torque, the new open source project by CartoDB, is a step towards making the process easier.

    Torque allows you to create beautiful visualizations with big temporal datasets by bundling HTML5 browser rendering technologies with a generic and efficient temporal data transfer format created using the CartoDB SQL API. Torque visualisations work on desktop and ipads, and work well on temporal datasets with hundreds of thousands or even millions of datapoints.

    It's still in the early stages but should be one to keep an eye on.

    Check out this map for a sense of what Torque can help you do. The map animates historical edits to OpenStreetMap in Madrid. Also this. [Thanks, Carlos]

  • Easy and customizable maps with TileMill

    September 21, 2012  |  Software

    Map with TileMill

    I'm late to this party. TileMill, by mapping platform MapBox, is open source software that lets you quickly and easily create and edit maps. It's available for OS X, Windows, and Ubuntu. Just download and install the program, and then load a shapefile for your point of interest.

    For those unfamiliar with shapefiles, it's a file format that describes geospatial data, such as polygons (e.g. countries), lines (e.g. roads), and points (e.g. landmarks), and they're pretty easy to find these days. For example, you can download detailed shapefiles for roads, bodies of water, and blocks in the United States from the Census Bureau in just a few clicks.

    The fun part is that you can easily customize the maps using a map stylesheet, which is similar to CSS. There are examples with the software, so you can get a feel for how everything fits together. You can also export your results as an image file or as SVG to edit in your favorite vector-editing software. Or if you want to publish your map online, it's straightforward to upload it to MapBox with an account.

  • Analyze your Facebook profile with Wolfram|Alpha

    September 3, 2012  |  Online Applications

    Facebook Wolfram Alpha

    Feeding off the momentum from Stephen Wolfram's personal analytics earlier this year, Wolfram|Alpha launched Facebook Analytics, which spits out graphs about your profile and your friends. You can see your activity over time, weekly distributions, and some general information about how people like and comment your status updates.

    I've only updated my Facebook status a few times this year, so the profile-focused information is interesting to me, but the second half of the report provides high-level aggregates about your friends. For example, I'm apparently at a stage in life where most of my friends are either married or in a relationship. You can also see how your friends are connected via a network graph.

    So you get more detail than you do out of current infographic-generators. The hook though is the links within the report that lead to information about your birthday or where you were born, kind of like when you end up reading about sasquatch on Wikipedia when your original search was actually work-related.

  • Resources for Getting Started with R

    June 4, 2012  |  Software

    R, the open source statistical software environment, is powerful but can be a challenge to approach for beginners. For me, the best way to learn R, especially on the visualization side of things, is to dive right in. Grab some data and make some charts, or better yet, find a graph you like and try to replicate it.

    R core functionality and the many available packages let you do a lot without having to know what's going on underneath. I use this approach in Visualize This and the tutorials around here. I like the satisfaction of immediate results. Then I learn the nitty gritty later.

    That said, it doesn't hurt to familiarize yourself with the environment. Also, visualization is a small part of what you can do with R, so it can help to know what else you can do analysis-wise.
    Continue Reading

  • New open data platform launches

    May 29, 2012  |  Software  |  Kim Rees

    Junar Open Data Platform

    Open data is everywhere. However, open data initiatives often manifest as mere CSV dumps on a forlorn web page. Junar, Lunfardo (Argentina slang) for "to know" or "to view," seeks to help government and organizations take the guesswork out of developing their own software for such efforts.

    Their open data platform allows organizations to collect and select their data, publish it, create reports and dashboards, and share their data online. The solution can be hosted or integrated into the organization's website, and the data can be made open or for internal use only. End users can "follow" live data on the site, download it, or embed it. There's also a built in API, so the organization doesn't have to develop one of their own.

    Junar looks like it's ready to fill the gap in open data publishing with its soup to nuts approach. With lots of great features and an easy to use interface, it seems like a welcome change to the alternatives.

  • More infographic software

    May 25, 2012  |  Online Applications  |  Kim Rees

    ScreenShot120

    Recently there's been a spate of infographic tools popping up (e.g., easel.ly, venngage, and infogr.am). Okay, I'm not sure if 3 qualifies as a spate, but it sure seemed like a lot in a short period of time. I gave Infogr.am a whirl, and it appears to be the front runner in terms of capabilities. Unlike easel.ly, you can *actually input data* into your infographic! What a novel concept. Venngage was hit and miss in terms of it accepting the data I entered. Infogr.am also has a bug in that you can't have the number 0 in your data. Go figure.
    Continue Reading

  • Venn pie-agrams

    May 23, 2012  |  Software  |  Kim Rees

    Venn Pie-ogram

    So I got to thinking, since I'm on this pie chart kick, "what would be the worst pie chart ever?" And I decided it would be a Venn diagram made with pie charts. I laughed to myself, imagining such a creation. Then I thought, somebody's probably done this. And indeed, there's an app for that.

    At long last, the power of Venn diagrams and pie charts combine to turn the world of mathematics on its head! If you've ever felt the need to create Venn diagrams with pie charts, or wished your pie charts could overlap to provide even more informative data, then Venn Pie-agrams is the app for you!

    I'll leave it at that.

  • Automated infographics with easel.ly

    May 13, 2012  |  Online Applications

    I'm pretty sure I'm not in their target audience, but my main takeaway from this video is that now, with easel.ly, you don't need time, money, or skill to make quality infographics. And the prezi-like video seems fitting.

    Maybe I'm just stuck in my ways, but I'm having trouble getting on board with these tools. Easel.ly, for example, provides themes, such as the one on the right. There's a guy in the middle with graphs around him and pointers coming out of his body. You get to edit however you want.

    So in this case, you start with a complete visual and then work your way backwards to the data, which I'm not sure how you can edit other than manually changing the size of the graphs. (Working with the interface takes some patience at this stage in the application's life.) It's rare that good graphics are produced when you go this direction.

    Instead, start with the data (or information) first and then build around that — don't try to fit the data (or information) into a space it wasn't meant for.

    Or maybe there's a lot more in store that we can't see yet. Either way, right now, the application is rough at best.

  • Miso: An open source toolkit for data visualisation

    April 23, 2012  |  Software

    Your online visualization options are limited when you don't know how to program. The Miso Project, a collaboration between The Guardian and Bocoup, is an effort to lighten the barrier to entry.

    While the goal is to build a toolkit that makes visualization easier and faster, the first release of the project is Dataset, a JavaScript library to setup the foundation of any good data graphic. If you've ever worked with data on the Web, you know there are a variety of (usually painful) steps you have to go through before you actually get to fun stuff. Dataset will help you with the data transformation and and management grunt work.

    One of the most common patterns we've found while building JavaScript-based interactive content is the need to handle a variety of data sources such as JSON files, CSVs, remote APIs and Google Spreadsheets. Dataset simplifies this part of the process by providing a set of powerful tools to import those sources and work with the data. Once data is in a Dataset, it becomes simple to select, group, and calculate properties of, the data. Additionally, Dataset makes it easy to work with real-time and changing data, which pose one of the more complex challenges to data visualization work.

    Gonna keep an eye on this one. I'm curious to see how the visualization component starts to build out.

  • Timelines that are Easy to Make and Use

    March 29, 2012  |  Software

    Easy timelines

    As a project of the Knight News Innovation Lab, Timeline by Verite is an open source project that lets you make and share interactive timelines. It's simple and customizable. Plug in your own data as JSON, or use the Google Docs template for an even faster route, and you're good to embed. It's also easy to grab source material from sites like Vimeo, YouTube, and Flickr. Score.

Copyright © 2007-2014 FlowingData. All rights reserved. Hosted by Linode.