He is right that the interface needs revision, we need to move on from current GUIs. I haven’t thought about the connection of the GUI and the physical input device so much but its true: scroll bars and buttons, drop lists etc are born because of the mouse pointer.
He didn’t talk about the changes top the GUI so much. All the demos for this Minority Report style interface always seem to be for visual applications. He said Spielberg wanted to get rid if the mouse and keyboard but this interface only replaces the mouse. I think voice recognition is going to be the keyboard killer.
I’d like to hear more about this ‘protein’ C++ thing for connecting screens/pixels together. I guess its just networking hardware together seamlessly. I think the web should already be doing this or it will as it replaces the OS. The next phase I guess.
This TED talk by Tom Wujec shows ways that visualising ideas helps to solve the problems. The “Visual Strategy Planning” idea, where a team maps out the entire problem on a wall, together, is a bit like a mind-map and is a nice interface to information.
It also has ramifications for learning in that new concepts could be presented to students as a map instead of a linear text.
The “science advisors” used on the movie Minority Report (3 stars from me coz it had Tom Snooze in it) teamed up with some techys and made the hand gesture interface real! Who needs a touch screen when you have this…