Minority Report Physical Interface in Real Life – Oblong g-speak

Posted to Visualization  |  Nathan Yau

Remember the awesome interface in Minority Report? You know, the one where Tom Cruise is sifting through files and information as if he were directing a symphony? Oblong, whose co-founder served as science adviser on the Steven Spielberg movie, created something a lot like it. It's called g-speak.

Oblong Industries is the developer of the g-speak spatial operating environment.

The SOE's combination of gestural i/o, recombinant networking, and real-world pixels brings the first major step in computer interface since 1984; starting today, g-speak will fundamentally change the way people use machines at work, in the living room, in conference rooms, in vehicles. The g-speak platform is a complete application development and execution environment that redresses the dire constriction of human intent imposed by traditional GUIs. Its idiom of spatial immediacy and information responsive to real-world geometry enables a necessary new kind of work: data-intensive, embodied, real-time, predicated on universal human expertise.

Here's the impressive demo reel:

Now here's the Minority Report clip for comparison's sake:

Of course g-speak is still in development and has a lot of work ahead before it's useful to explore "massive datasets" but it's a good first step nevertheless. Plus, it just looks fun to play with. I wonder what it'd do if I gave it an obscene gesture.

[via Data Mining and Engadget]


  • Kevin Carlson November 17, 2008 at 3:59 pm

    Might respond with something like “I’m afraid I can’t do that, Dave”… ;)

    Seriously, though, gestural and voice recognition seem like the logical progression of UI, especially as mobile device screens get more compact. My pocket camera has “face recognition” built in. If “hand recognition” can eliminate the need for special gloves, then the next step might be sign language processing, converting ASL gestures to synthesized speech for deaf persons…

    (I felt that Cruise’s grand arm gestures were somewhat impractical, leading to sore arms in short order for many people. As devices become more portable, subtle gestures, even facial expression recognition may be feasible…)

  • hehe, well yeah, the big movements were clearly for show. There was also this exhibit, iPoint, at Wired NextFest:


    It wasn’t as sexy, but uses the same principle of hand recognition.

  • I can’t help but compare my recent foray into smartphone territory to this. I tried the G1 phone, and found it technologically fascinating, with many nice touches, but practically pointless. I then opted for a dumber smartphone that perfectly fits what I need, has those features I really need (rather than those I presumed I needed due to hype surrounding the iPhone, G1, etc.).

    This sort of UI, and Microsoft’s virtual desktop demos of recent years, are similarly fascinating; but the energy and context requirements are so taxing and specific I don’t anticipate them finding wide purchase in userland for some time, if ever. This might be “Who would ever need more than 640K of memory?” but is there really so much improvement to be made to the simple push of a button?

  • Thanks for the nice youtube video.


Pizza Place Geography

Most of the major pizza chains are within a 5-mile radius of where I live, so I have my pick, …

Jobs Charted by State and Salary

Jobs and pay can vary a lot depending on where you live, based on 2013 data from the Bureau of Labor Statistics. Here’s an interactive to look.

Famous Movie Quotes as Charts

In celebration of their 100-year anniversary, the American Film Institute selected the 100 most memorable quotes from American cinema, and …

How We Spend Our Money, a Breakdown

We know spending changes when you have more money. Here’s by how much.