Behind the Netflix recommendation system

Posted to Statistics  |  Tags: ,  |  Nathan Yau

Wired has a fun Netflix interview on the behind-the-scenes work on the recommendation engine.

If you liked 1960s Star Trek, the first non-Trek title that Netflix is likely to suggest to you is the original Mission: Impossible series (the one with the cool Lalo Schifrin soundtrack). Streaming the latest Doctor Who is likely to net you the supernatural TV drama Being Human (the UK version). Watch From Dusk Till Dawn and 300 and say hello to a new row on your homepage: Visually Striking Violent Action & Adventure. Trying to understand the invisible array of algorithms that power your Netflix suggestions has long been a favorite sport, but what’s actually going on in that galaxy of big data, those billions and billions of ratings stars? Turns out there are 800 Netflix engineers working behind the scenes at their Silicon Valley HQ. The company estimates that 75 percent of viewer activity is driven by recommendation.

Some days you just want slouch back on the couch after a long day’s work and watch Hot Tub Time Machine.

Favorites

Reviving the Statistical Atlas of the United States with New Data

Due to budget cuts, there is no plan for an updated atlas. So I recreated the original 1870 Atlas using today’s publicly available data.

Top Brewery Road Trip, Routed Algorithmically

There are a lot of great craft breweries in the United States, but there is only so much time. This is the computed best way to get to the top rated breweries and how to maximize the beer tasting experience. Every journey begins with a single sip.

Years You Have Left to Live, Probably

The individual data points of life are much less predictable than the average. Here’s a simulation that shows you how much time is left on the clock.

Watching the growth of Walmart – now with 100% more Sam’s Club

The ever so popular Walmart growth map gets an update, and yes, it still looks like a wildfire. Sam’s Club follows soon after, although not nearly as vigorously.