Trifacta Wrangler to format and clean data

Posted to Software  |  Tags: ,  |  Nathan Yau

Data wrangling — formatting and cleaning — is a sore spot and stumbling block for many, but you often can’t do much visualization- or analysis-wise until the data is in order. My projects folder is filled with one-off Python scripts written for specific datasets (and steps within steps).

Trifacta Wrangler aims to streamline the process with a click interface and automation. The desktop software is free to use and available for PC and Mac.

When you open the application for the first time, helpful tips pop up to take you through the usual steps. Load a dataset, and it tries to figure out the format on its own, defining columns as text, numeric, binary, or something else among the ten or so categories.

Trifacta Wrangler

Then you get a view that resembles the above. It’s a visual summary of the dataset. Again, this is focused on wrangling and the very initial steps of analysis, so it shows stuff like percentage of missing values or columns that seem to have mismatched formats.

This worked well for my dataset with little help from me. I really like the view as a way to take inventory of what’s there.

Then you can use the Transformer to modify the data. Admittedly, I got lost during my first pass. There’s a script generator so that you can reproduce results, and you can manually edit the script to get your data just so. I’ll have to play around with this some more.

All in all, at first look, Wrangler (still in Beta by the way) looks promising. Honestly, I’m so used to writing one-off scripts that I might never get to using it more extensively, but I’ll keep it in the toolbox.

Favorites

Divorce Rates for Different Groups

We know when people usually get married. We know who never marries. Finally, it’s time to look at the other side: divorce and remarriage.

A Day in the Life of Americans

I wanted to see how daily patterns emerge at the individual level and how a person’s entire day plays out. So I simulated 1,000 of them.

Who is Older and Younger than You

Here’s a chart to show you how long you have until you start to feel your age.

Real Chart Rules to Follow

There are rules—usually for specific chart types meant to be read in a specific way—that you shouldn’t break. When they are, everyone loses. This is that small handful.