Claudio Pinhanez - Publication Abstract

Everywhere Displays: Publications

Title	Ubiquitous Interactive Graphics
Author	Claudio Pinhanez,Rick Kjeldsen,Tony Levas, Gopal Pingali, Mark Podlaseck, Paul Chou
Abstract	This paper presents a device that creates ubiquitous interactive graphics in a real world environment without the need for pre-wiring surfaces or requiring users to carry or wear any special devices. Called the Everywhere Displays projector, or ED-projector, this device employs steerability as the key principle to achieve the promise of ubiquitous computing and augmented reality. The ED-projector uses an LCD projector with a steerable mirror to project graphics onto any pre-calibrated surface, while warping the projected image to correct for oblique distortion. Three different methods to determine this warping function are given. To sense user interaction with the projected image, the ED-projector employs a pan/tilt/zoom camera and a motion-based computer vision system to track the user's hand and touch-like gestures. We propose a system software structure that ties together steering, display, and sensing. Three implemented applications demonstrate the notion of ubiquitously "painting" the real world with interactive graphics, in the context of a futuristic office, an augmented assembly task, and a ubiquitous computer game. The observation of hundreds of users performing the assembly task suggests that the traditional desktop paradigm is inadequate for ubiquitous interaction and that new conceptual widgets and interaction paradigms must be developed.
Venue	IBM Research Report RC22495 (W0205-143), May 17, 2002
Availability	PDF Request harcopy