Gesture-based computing on the cheap

Gesture-based computing on the cheap. “With a single piece of inexpensive hardware — a multicolored glove — MIT researchers are making Minority Report-style interfaces more accessible.”

Check out the video: <object id=”flashObj” width=”486″ height=”412″ classid=”clsid:D27CDB6E-AE6D-11cf-96B8-444553540000″ codebase=”http://download.macromedia.com/pub/shockwave/cabs/flash/swflash.cab#version=9,0,47,0″><param name=”movie” value=”http://c.brightcove.com/services/viewer/federated_f9/36804639001?isVid=1″ /><param name=”bgcolor” value=”#FFFFFF” /><param name=”flashVars” value=”videoId=86656499001&playerID=36804639001&domain=embed&dynamicStreaming=true” /><param name=”base” value=”http://admin.brightcove.com” /><param name=”seamlesstabbing” value=”false” /><param name=”allowFullScreen” value=”true” /><param name=”swLiveConnect” value=”true” /><param name=”allowScriptAccess” value=”always” /><embed src=”http://c.brightcove.com/services/viewer/federated_f9/36804639001?isVid=1″ bgcolor=”#FFFFFF” flashVars=”videoId=86656499001&playerID=36804639001&domain=embed&dynamicStreaming=true” base=”http://admin.brightcove.com” name=”flashObj” width=”486″ height=”412″ seamlesstabbing=”false” type=”application/x-shockwave-flash” allowFullScreen=”true” swLiveConnect=”true” allowScriptAccess=”always” pluginspage=”http://www.macromedia.com/shockwave/download/index.cgi?P1_Prod_Version=ShockwaveFlash”></embed></object>

Here’s some information about how the researcher developed the glove, iterating through different designs. “The glove went through a series of designs, with dots and patches of different shapes and colors, but the current version is covered with 20 irregularly shaped patches that use 10 different colors. The number of colors had to be restricted so that the system could reliably distinguish the colors from each other, and from those of background objects, under a range of different lighting conditions. The arrangement and shapes of the patches was chosen so that the front and back of the hand would be distinct but also so that collisions of similar-colored patches would be rare. For instance, Wang explains, the colors on the tips of the fingers could be repeated on the back of the hand, but not on the front, since the fingers would frequently be flexing and closing in front of the palm.”

Pretty fast rendering there, which is due to the fact that the computer is simply looking up images in a database, and then figuring out which position the hand is in. I really like how simple the calibration is: “To calibrate the system, the user simply places an 8.5-by-11-inch piece of paper on a flat surface in front of the webcam, presses his or her hand against it, and in about three seconds, the system is calibrated.”