AR[2]

Iron Man the Movie uses Augmented Reality (AR) as a part of the Jarvis vision system and demonstrates it pretty well. The system segregates the view into various objects it can recognize and overlays information on it. This is quite a futuristic view of what AR could do. This is how we could hypothetically achieve it.

  • Hardware: Vuzix Wrap 920AR connected to an internet connected  Windows laptop in a backpack

  • Services: WolframAlpha and Google Goggles like reverse image search

  • Software Skills: Object/Face tracking and WPF for cool UI
  • Segregate objects from a video feed at 5-10 fps
  • Use image analysis techniques and separate environment from objects
  • Distinguish separate objects to create unique images and pass them as inputs to a reverse image search engine
    • “Reverse image search returns keywords based on images sent to it, like google goggles but more streamlined”
  • Take returned keyword into Wolfram alpha for an awesome tabulated result
  • Use the Facebook API to detect faces and get profile information – if faces are detected.
  • Overlay table into a WPF layer and modify it to display a moving UI on the tracked image, feed this back to the Vuzix Display to overlay the data
    • this step is in the loop until the tracking breaks – then find the object within the image again and re-track it.
  • This can be used as long as the object is not in scene for a couple of seconds or if a new object is detected. once a new object is detected. use the SIFT algorithm to search if the old image is still in the scene after a few seconds. if not – move on to the next object detected.
  • Cost can be high on constant reverse engine search. a personal database of object in the neighbourhood, like a cached copy of Google/Bing street view with information on what is what will help speed up things. keep everything cached for a realistic experience
  • Caching in advance based on GPS locations can also be done, if this is being used on the street. will work great with museums and industrial/commercial complexes.
  • You can also use a PC version of LayAR reality browser with the headgear for added effects

    • Related Posts