Amazing Augmented Reality Tech Unveiled at TED

February 5, 2009 by sean.

One word: wow! [via wired]:

Pattie Maes of the MIT Media Lab’s Fluid Interfaces group demonstrated a wearable computing system that turns any surface into a display screen, becoming a kind of “sixth sense” for the user. The prototype involves an ordinary web cam and battery-powered 3M projector with an attached mirror that are all connected to an internet-enabled mobile phone. The set-up, which costs less than $350, allows the user to project information from the phone onto any surface — walls, the body of another person or even your hand.

Maes showed a video of her student Pranav Mistry who she describes as the genius behind the project. Mistry wore the device on a lanyard around his neck, along with colored Magic Marker caps on four fingers, each one red, blue, green or yellow to allow the camera to distinguish the four fingers. The caps help the camera recognize his hand gestures with software that Mistry created. The gestures can be something as simple as using his fingers and thumbs to create a picture frame that tells the camera to snap a photo, which is saved to his mobile phone. When he gets back to an office, he projects the images onto a wall and begins to size them.

When he encounters someone at a party, the system calls up information about him and projects a cloud of words on the person’s body to help him remember the person or provide more information about him, such as his blog URL, the name of his company, his likes and interests. “This is a more controversial [feature],” Maes said over the audience’s laughter.

Posted in innovation, pervasive computing, software, augmented cognition, mobile computing | No Comments »