The flood. The avalanche. The tsunami. Drowning in data. For the past few years, a couple of times a week, there’s an article about all the data we have access to and how we’re struggling to stay afloat in the growing sea of data. Big data is getting too big they say.
The water metaphor is fine, but the fear of the data flow is irrational, so let’s
run swim with the former.
First, the floods and tsunamis. This makes it sound as if the flows of data are uncontrolled, and there’s no way to contain them when they storm to our doorstep. However, you could just turn off the nozzle, or filter, cut, and query to what you want. And these days, we practically have infinite storage, so although the source of water increases, the reservoir and dam can grow with it.
Hit delete if the data gets too big, or bottle it and save it for later.
When you learn to swim, you start at the shallow end, and work your way towards the deep end. If you’re more adventurous, you snorkel or go deep sea diving. Even then you don’t swim the entire ocean right away. You explore a little bit at a time. You chip away at the database a little bit at a time, and what you learn during one dive carries over to the next. Sure, people drown in the ocean, but the good news is that when you drown in data, you still get more chances to learn and try again.
You don’t even have to go to the ocean right away. Although they’re small, ponds and lakes can be interesting too. (Think hyperlocal.) If you really must, make friends with one of those guys from Deadliest Catch and have him bring you what you want to study. Better yet, become a greenhorn with the best captain you can find and learn the subtleties of the sea.
At the end of the day, more data means more opportunity, and if you know how to doggy paddle, you’re going to be okay. Know how to do more than that? All the better. Keep learning.
Even if you can’t swim, there are a variety of alternatives — life preservers, rafts, and those inflatable floating chairs with the cup holder to put your ice cold beer. Drowning in data? Nah.