What a computer sees while watching movies

Posted to Data Art  |  Tags: ,  |  Nathan Yau

Benjamin Grosser visualized how computers “watch” movies through vision algorithms and artificial intelligence in Computers Watching Movies.

Computers Watching Movies was computationally produced using software written by the artist. This software uses computer vision algorithms and artificial intelligence routines to give the system some degree of agency, allowing it to decide what it watches and what it does not. Six well-known clips from popular films are used in the work, enabling many viewers to draw upon their own visual memory of a scene when they watch it.

Above is the bag scene from American Beauty. Contrast this with the more frantic Inception scene, and you get a good idea of how it works. See computer-watching scenes for several more movies here.

Favorites

Pizza Place Geography

Most of the major pizza chains are within a 5-mile radius of where I live, so I have my pick, …

Interactive: When Do Americans Leave For Work?

We don’t all start our work days at the same time, despite what morning rush hour might have you think.

Marrying Age

People get married at various ages, but there are definite trends that vary across demographic groups. What do these trends look like?

19 Maps That Will Blow Your Mind and Change the Way You See the World. Top All-time. You Won’t Believe Your Eyes. Watch.

Many lists of maps promise to change the way you see the world, but this one actually does.