Augmentality

In my ongoing research regarding augmented reality at Columbia University I found the following video.  It is an application and technology called “opportunistic controls”.  This technology uses gesture-based inputs and allows users to physically interact with the immediate environment while also receiving feedback from the augmented reality system.   Although the visuals are fairly rudimentary it is easy to see how the system can be applied.

One such application is with mechanics.  For example, during an inspection of an engine the mechanic has to check multiple point within the engine.  After each point the mechanic has to document his or her findings in a computer.  This can take a long time, especially when the inspection includes 20 or even 100 checkpoints.

With an augmented reality system the mechanic can simply look at the checkpoint, then record his or her findings with the system.  This is precisely what you see in the video above.

Imagine the possibilities!  Now any task can not only be worked through, but also documented without ever leaving the immediate environment.  And, this is exactly what the  research group has found:

“Opportunistic Controls allowed participants to complete their tasks significantly faster and were preferred over the baseline technique.”

Columbia University has been doing augmented reality research for over a decade now. And, if you look hard enough you will find some great pages dedicated to these research projects. I happened to stumble upon one such project and this is what I found.

It is a video about markers and “visual hints” technology.  Unlike many of the ads and sorta gimmicky things you may find today, “visual hints” technology can understand gestures.  Instead of merely having a 3D image rotate the program can understand that a gesture is being made and react to it appropriately.  See for yourself, it’s pretty cool stuff.

So what makes this technology so special?  Well, first off, this technology can teach people how to interact with objects designed for augmented reality.  Would you know how to rotate to the next image without the system “teaching” you what the gesture is to do so?  Or, how would you even know there is another image associated with the marker?  Simply put, this is a great way to teach people how to interact with the new augmented reality environment.

Nearly a year ago, TechCrunch posted a nice little article on Tonchindot, a Japanese company that is producing a program similar to Sprxmobile’s Layar. Tonchidot’s Sekai Camera is an augmented reality program that takes video images taken from the camera and overlays it with data driven from within the software. The video shows more about the software specifics, so I won’t bore you with them here. Simply put, the thing is amazing!

One thing that is super cool is that the software pulls from a server actual data about products in different stores.  So, for example, when you look at a camera in a store Sekai Camera will give you information about the camera; like the specs, price, rival prodects, ect.

PS – They say they will not sellout to Google … we’ll see about that.

This is a great video that shows the potential of not just augmented reality, but also the iPhone. Parallel tracking and mapping (PTAM) is extremely advanced, and what I believe to be the real application of augmented reality. Markers are cool, and seeing a baseball player spring from a piece of paper on your screen is neat. But, PTAM will soon lead out as the tech of choice for any augmented reality developer. Personally, I can’t wait!

I happened across this video not long ago.  It really shows the power of using augmented reality in a presentation.  Even though the live audience may not get to experience the cool factor, those online will have something extra to keep their attention.