3D in-world Telepresence With Camera-Tracked Gestural Interaction
MetadataShow full item record
While many education institutes use Skype, Google Chat or other commercial video-conferencing applications, these applications are not suitable for presenting architectural or urban design or archaeological information, as they don't integrate the presenter with interactive 3D media. Nor do they allow spatial or component-based interaction controlled by the presenter in a natural and intuitive manner, without needing to sit or stoop over a mouse or keyboard. A third feature that would be very useful is to mirror the presenter's gestures and actions so that the presenter does not have to try to face both audience and screen. To meet these demands we developed a prototype camera-tracking application using a Kinect camera sensor and multi-camera Unity windows for teleconferencing that required the presentation of interactive 3D content along with the speaker (or an avatar that mirrored the gestures of the speaker). Cheaply available commercial software and hardware but coupled with a large display screen (in this case an 8 meter wide curved screen) allows participants to have their gestures, movements and group behavior fed into the virtual environment either directly or indirectly. Allowing speakers to present 3D virtual worlds remotely located audiences while appearing to be inside virtual worlds has immediate practical uses for teaching and long-distance collaboration.
Showing items related by title, author, creator and subject.
Pritchard, M.; Dipper, L.; Morgan, G.; Cocks, Naomi (2015)Background: Conveying instructions is an everyday use of language, and gestures are likely to be a key feature of this. Although co-speech iconic gestures are tightly integrated with language, and people with aphasia (PWA) ...
Guna, J.; Stojmenova, E.; Lugmayr, Artur; Humar, I.; Pogacnik, M. (2014)We present an intuitive, implicit, gesture based identification system suited for applications such as the user login to home multimedia services, with less strict security requirements. The term “implicit gesture” in ...
Atkinson, Doug; Orzechowski, P.; Petreca, B.; Bianchi-Berthouze, N.; Watkins, P.; Baurley, S.; Padilla, S.; Chantler, M. (2013)Current interactive media presentations of textiles provide an impoverished communication of their 'textile hand', that is their weight, drape, how they feel to touch. These are complex properties experienced through the ...