He is right that the interface needs revision, we need to move on from current GUIs. I haven’t thought about the connection of the GUI and the physical input device so much but its true: scroll bars and buttons, drop lists etc are born because of the mouse pointer.
He didn’t talk about the changes top the GUI so much. All the demos for this Minority Report style interface always seem to be for visual applications. He said Spielberg wanted to get rid if the mouse and keyboard but this interface only replaces the mouse. I think voice recognition is going to be the keyboard killer.
I’d like to hear more about this ‘protein’ C++ thing for connecting screens/pixels together. I guess its just networking hardware together seamlessly. I think the web should already be doing this or it will as it replaces the OS. The next phase I guess.
A set composition which is moved forward by live triggers.
Using an acoustic instrument as a controller. Possibly using pitch detection.
Using video, text and spoken word for “conceptional content” in combination with the abstraction of music/sound.
Integration of poetry medium was nice.
I wasn’t so much impressed with the actual choice of content of the piece but the delivery and the fast pace of the musical style combined was very effective. I imagine live it would have a great impact assuming you were standing close enough.
He seemed stuck behind the instrument and sheet music so would be physically constrained in meeting the audience and thus have less options with engaging them.
Ideas for future directions from here might be:
Gesture recognition, i.e. series of notes, a “music phrase” as triggers for navigating the composition, perhaps allowing for non-linear compositions. Also for triggering smaller sequences of visuals/spoken-word
Different interface to make music which allows more interaction with the audience. Perhaps wireless sensors.
1. Experience bars measuring progress.
- Give people an Avatar and they can take ownership
2. Multiple long & short term aims
- 5000 targets not interesting. 5-20 interested
3. Reward effort
- Every little bit!
4. Rapid, frequent clear, feedback.
- Immediate is best.
5. An element of uncertainty
- Uncertain rewards
- When we predict something wrong we get excited about it.
- Dopamine, neuron transmitter associated with learning.
6. Windows of enhanced attention.
- Memory - find moments when people are more likely to remember
- & confidence - reward system make people will to take risks
7. Other people!
- The most exciting reward
This is a great TED talk from Tim Berners-Lee who created the internet. Here he talks about Linked Data and the importance of sharing and linking data.
Just as with his first break-through, the hyperlink, he realises that its the links that make things useful. To take this on step further the linking is how we embed mean into web documents. The same applied with data. Data by itself is not as useful as data linked to other data and this linkage is meaningful.
Linking was only half the story and Tim doesn’t talk about the importance of standardising the data format, which by the way he also underestimated with HTML and why web developers have had a nightmare with different web browsers interpretation of HTML. Data formats is the less exciting half of the equation but is going to be just as critical. Especially with numbers like dates, currencies, measurements (and their metrics) etc. I’m thinking (hoping, praying) that we’ve learnt our leasons from HTML and people know when and how to draw up a standard for data formats before this thing explodes.
This TED talk by Tom Wujec shows ways that visualising ideas helps to solve the problems. The “Visual Strategy Planning” idea, where a team maps out the entire problem on a wall, together, is a bit like a mind-map and is a nice interface to information.
It also has ramifications for learning in that new concepts could be presented to students as a map instead of a linear text.
I’ve been inspired by a great lecture, The Web that Wasn’t by Alex Wright, which traces the history of precursor ideas and thinking that ether lead to the web or where ideas much greater than the Internet is right now.
The “science advisors” used on the movie Minority Report (3 stars from me coz it had Tom Snooze in it) teamed up with some techys and made the hand gesture interface real! Who needs a touch screen when you have this…
This summer I hung out in the Czech Republic in the lovely town of B?ha?ov with Sonya. Tina and her boyfriend Phill dropped by and Julia so, inspired by the movie Zombie Lake (1981), we decided to make a music-video called Making Fools, which is now up on Sonya’s website. It is my first completed track (so far, and not really indicative of what I’m into but it was made in one day with on a nasty hangover).