Augmentality

In my ongoing research regarding augmented reality at Columbia University I found the following video.  It is an application and technology called “opportunistic controls”.  This technology uses gesture-based inputs and allows users to physically interact with the immediate environment while also receiving feedback from the augmented reality system.   Although the visuals are fairly rudimentary it is easy to see how the system can be applied.

One such application is with mechanics.  For example, during an inspection of an engine the mechanic has to check multiple point within the engine.  After each point the mechanic has to document his or her findings in a computer.  This can take a long time, especially when the inspection includes 20 or even 100 checkpoints.

With an augmented reality system the mechanic can simply look at the checkpoint, then record his or her findings with the system.  This is precisely what you see in the video above.

Imagine the possibilities!  Now any task can not only be worked through, but also documented without ever leaving the immediate environment.  And, this is exactly what the  research group has found:

“Opportunistic Controls allowed participants to complete their tasks significantly faster and were preferred over the baseline technique.”

Columbia University has been doing augmented reality research for over a decade now. And, if you look hard enough you will find some great pages dedicated to these research projects. I happened to stumble upon one such project and this is what I found.

It is a video about markers and “visual hints” technology.  Unlike many of the ads and sorta gimmicky things you may find today, “visual hints” technology can understand gestures.  Instead of merely having a 3D image rotate the program can understand that a gesture is being made and react to it appropriately.  See for yourself, it’s pretty cool stuff.

So what makes this technology so special?  Well, first off, this technology can teach people how to interact with objects designed for augmented reality.  Would you know how to rotate to the next image without the system “teaching” you what the gesture is to do so?  Or, how would you even know there is another image associated with the marker?  Simply put, this is a great way to teach people how to interact with the new augmented reality environment.