Whisper Deck prototype

The “Whisper Deck” is an experimental voice-controlled augmented reality data visualization interface (wow, that’s a mouthful!)  The system allows you to don a pair head-mounted goggles and speak commands into a small microphone.  These commands are then recognized by a speech-to-text parser and executed in augmented reality in near real-time.  Think of it like a simplistic, very awkward non-tangible holodeck :)

As of today the system can help to visualize search volume using a tie in to Google Trends.  Simply speak the command “compare” followed by a series of keywords and the Whisper Deck will do the rest! Here’s a quick video that shows the prototype in action.

Now that I have a working prototype I hope to expand the systems functionality to do a number of things, including:

  1. Access to additional APIs (Wikipedia, Google Images, Facebook, etc.)
  2. New commands that provide visual, 3D search capabilities
  3. Export options for Twitter and Facebook (say “tweet this” and a snapshot of your page + a brief spoken caption are uploaded to a twitter feed)

Tags: , , , ,

Leave a Reply