He is right that the interface needs revision, we need to move on from current GUIs. I haven’t thought about the connection of the GUI and the physical input device so much but its true: scroll bars and buttons, drop lists etc are born because of the mouse pointer.
He didn’t talk about the changes top the GUI so much. All the demos for this Minority Report style interface always seem to be for visual applications. He said Spielberg wanted to get rid if the mouse and keyboard but this interface only replaces the mouse. I think voice recognition is going to be the keyboard killer.
I’d like to hear more about this ‘protein’ C++ thing for connecting screens/pixels together. I guess its just networking hardware together seamlessly. I think the web should already be doing this or it will as it replaces the OS. The next phase I guess.