What a computer sees while watching movies

Posted to Data Art  |  Tags: ,  |  Nathan Yau

Benjamin Grosser visualized how computers “watch” movies through vision algorithms and artificial intelligence in Computers Watching Movies.

Computers Watching Movies was computationally produced using software written by the artist. This software uses computer vision algorithms and artificial intelligence routines to give the system some degree of agency, allowing it to decide what it watches and what it does not. Six well-known clips from popular films are used in the work, enabling many viewers to draw upon their own visual memory of a scene when they watch it.

Above is the bag scene from American Beauty. Contrast this with the more frantic Inception scene, and you get a good idea of how it works. See computer-watching scenes for several more movies here.

Favorites

10 Best Data Visualization Projects of 2015

These are my picks for the best of 2015. As usual, they could easily appear in a different order on a different day, and there are projects not on the list that were also excellent.

Where Bars Outnumber Grocery Stores

A closer look at the age old question of where there are more bars than grocery stores, and vice versa.

Who is Older and Younger than You

Here’s a chart to show you how long you have until you start to feel your age.

How We Spend Our Money, a Breakdown

We know spending changes when you have more money. Here’s by how much.