Multimodal interaction in virtual reality

I. Wachsmuth

Faculty of Technology, University of Bielefeld, Bielefeld, Germany

This contribution reports work carried out in Bielefeld in the context of interacting with virtual reality environments. Three things are important in our work toward incorporating gestures as a useful tool in virtual reality:

The things we have learned from investigating these issues help us to advance natural interaction with 3D stereographic scenes in a scenario of virtual construction. In the first place we have dealt with pointing and turning, etc., often classified as deictic and mimetic gestures. In the DEIKON project, we have now started to investigate more sophisticated forms of deictics in construction dialogues that include features indicating shape or orientation, which leads us into iconic gesture. Another issue in our work is the synthesis of lifelike gesture from symbolic descriptions for an articulated virtual figure where natural motion and timing are central aspects.


Poster presented at Measuring Behavior 2000, 3rd International Conference on Methods and Techniques in Behavioral Research, 15-18 August 2000, Nijmegen, The Netherlands

© 2000 Noldus Information Technology b.v.