-
An often painful yet necessary step in visualization is to get your data in the right format. Arquero, from the University of Washington Interactive Data Lab, aims to make this part of the process easier:
Arquero is a JavaScript library for query processing and transformation of array-backed data tables. Following the relational algebra and inspired by the design of dplyr, Arquero provides a fluent API for manipulating column-oriented data frames. Arquero supports a range of data transformation tasks, including filter, sample, aggregation, window, join, and reshaping operations.
Before working with JavaScript, I almost always end up in R or Python to get the data where it needs to be. I’m curious if this’ll help streamline the process, if just by a bit.
-
For your analytical perusal, Emil Hvitfeldt provides ten seasons’ worth of scripts from the Friends sitcom in an easy-to-use R package:
The goal of friends to provide the complete script transcription of the Friends sitcom. The data originates from the Character Mining repository which includes references to scientific explorations using this data. This package simply provides the data in tibble format instead of json files.
The ten seasons ran from 1994 to 2004. I’m suddenly feeling my age.
-
North Drinkware molded Half Dome in the bottom of a hand-blown pint glass using elevation data from the United States Geological Survey. Wow. [via @blprnt]
-
Bloomberg mapped tree loss between 2000 and 2019 in Brazil:
“What we have seen in Brazil is that rainforest protection is a highly political issue,” says Gerlein-Safdi of the University of Michigan. “With every change in government, laws can change very quickly, both for better or for worse.”
In some areas, the damage has been done. Efforts to build roads through the forest have opened up large swaths to exploitation. Satellite images of a new highway through the Amazon show how fast the land use changes from primary forest to agricultural land once logging companies and farmers gain access.
The maps are based on an analysis by University of Maryland geographers. The researchers compared satellite imagery over time to compare forest changes on a global scale, and you can download the data here.
-
With mail-in ballots looking to be more common than ever this year, NYT’s The Upshot is tracking the mail:
The data here, covering more than 28 million pieces of first-class letters tracked by SnailWorks, shows how on-time delivery declined noticeably in July after the arrival of Louis DeJoy, the Trump-aligned postmaster general, and the start of policies to trim transportation costs. That drop in national performance was more abrupt than during the chaotic period when the coronavirus pandemic began spreading across the country.
“We had a wave of our members, hundreds and hundreds of locals, telling us there were service problems a month ago,” said Jim Sauber, the chief of staff for the National Association for Letter Carriers.
Hm.
I wonder what the distributions for each time frame looks like. Even during non-pandemic times, it looks like a quarter of the mail is counted as late. And it’s at least a little bit comforting that we’re talking in units of days late rather than weeks or months.
-
The Washington Post provides another straightforward voting guide, based on where you live and how you plan to vote.
Election season is always interesting graphics-wise, because all of the news outlets are starting with the same data and information. But they all show the data a little differently, asking various questions or using different visual approaches.
Things are just getting started, but contrast this Post piece with FiveThirtyEight’s voting guide. The former zeros in on the your voting scenario, whereas the latter still gives some space for the overall national view.
-
Reddit user WhiteCheeks used dot density to show population counts of various animals. Each dot represents an animal. So animals with lower counts show less obviously.
This is similar to the use of pixelation to show endangered species, which I think works better since the size of the dots above don’t encode anything.
-
Members Only
-
The wind was blowing smoke and ash from wildfires further up north from where I live. The sky turned an eerie orange. I wondered about past fires and made the chart below.
-
The math behind wearing a mask can seem unintuitive at times. Minute Physics and Aatish Bhatia break it down in this illustrated video to show why wearing masks works:
The premise is that there’s a two-way effect with breathing in and breathing out. There are some assumptions here, but there’s an interactive component that lets you adjust the variables. They’ve also made the code available.
-
For The Pudding, Ilia Blinderman rounds out his three-part series on creating visual, data-driven essays. This last part in on the fuzziest task of telling stories:
Storytelling, however, is much more abstract — it’s not merely a technical matter of creating an image of a map, or designing the right chart; rather, it refers to the broader universe of considerations that impact nearly every decision you make in the way you frame and present a project. The focus is much less on the technical “how,” like in the first two installments of these guides, but on the “why” of designing the narrative. It certainly doesn’t help that technical tools are inherently more concrete: they’re ways of solving specific problems (e.g., “how do I show the locations where people are concentrated on a map?” or “how do get this visual element to move through this specific path?”), while storytelling is much more of a nebulous concept. Thus, in this guide, I’ll be focusing on the relevant questions and considerations that we, at The Pudding, tend to consider when creating data-driven projects.
-
Picking colors for your charts can be tricky, especially when you’re starting a palette from scratch. For Datawrapper, Lisa Charlotte Rost has been writing guides on color as it pertains to political parties, gender, and more recently, colorblindness. Rost put the pieces together for a single, more comprehensive guide on the subject.
Be sure to check out Rost’s other guides on making better charts. She has a knack for explaining visualization methods in a practical and concrete way.
-
As we have seen, small shifts in voting behavior of various demographic groups can swing an election. The Washington Post provides an interactive that lets you shift these groups by both turnout and vote margin to see what might happen (based on a simplified model).
-
Members Only
-
From Reddit user wequiock_falls, “What I’m about to learn about after my kid says, ‘Wanna know somefing?’ Data collected over the course of 7 days.”
Sounds about right.
-
There’s a 6 percent figure from the CDC that could be easily misinterpreted. Here’s what it means.
-
For NYT’s The Upshot, Tim Wallace and Krishna Karra looked at how the red-blue electoral map relates to the green and gray color spectrum in satellite imagery:
The pattern we observe here is consistent with the urban-rural divide we’re accustomed to seeing on traditional maps of election results. What spans the divide — the suburbs represented by transition colors — can be crucial to winning elections. It’s part of why President Trump, seeking to appeal to swing voters, has portrayed the suburbs as under siege and menaced by crime. But the suburbs are neither politically nor geographically monolithic. They are where Democratic and Republican voters meet and overlap, in a variety of ways.
The breakdown and process are impressive. Be sure to check out the full rundown. Wallace also provides more details about how this came together on the Twitter.
-
The election is full of what-ifs, and the result changes depending on which direction they take. Josh Holder and Alexander Burns for The New York Times use a pair of circular Voronoi diagrams and draggable bubbles so that you can test the what-ifs.
Contrast this with NYT’s 2012 graphic showing all possible paths. While the 2012 graphic shows you the big picture, the 2020 interactive places more weight on individual outcomes.
-
Each state is handling mail-in voting in a certain way with varying timelines and rules. FiveThirtyEight provides a straightforward state-by-state guide so you can see what your state is doing.
I like the color-coded grid map doubling as quick navigation. You get the overview and a jump to the state of interest.