What a computer sees while watching movies

Jan 28, 2014

Benjamin Grosser visualized how computers “watch” movies through vision algorithms and artificial intelligence in Computers Watching Movies.

Computers Watching Movies was computationally produced using software written by the artist. This software uses computer vision algorithms and artificial intelligence routines to give the system some degree of agency, allowing it to decide what it watches and what it does not. Six well-known clips from popular films are used in the work, enabling many viewers to draw upon their own visual memory of a scene when they watch it.

Above is the bag scene from American Beauty. Contrast this with the more frantic Inception scene, and you get a good idea of how it works. See computer-watching scenes for several more movies here.

Favorites

Graphical perception – learn the fundamentals first

Before you dive into the advanced stuff – like just about everything in your life – you have to learn the fundamentals before you know when you can break the rules.

Reviving the Statistical Atlas of the United States with New Data

Due to budget cuts, there is no plan for an updated atlas. So I recreated the original 1870 Atlas using today’s publicly available data.

10 Best Data Visualization Projects of 2017

It was a rough year, which brought about a lot of good work. Here are my favorite data visualization projects of the year.

Unemployment in America, Mapped Over Time

Watch the regional changes across the country from 1990 to 2016.