|
SYMPOSIUM Annotating and measuring meeting behaviorORGANIZED
BY: Betsy van Dijk, Anton Nijholt, Dirk Heylen(University of Twente, Enschede, The Netherlands) The AMI (Augmented Multi-party Interaction) project aims at developing technologies that can facilitate human interaction in the context of instrumented meeting rooms, which includes remote participant support and the possibility to browse through past meetings. Research areas in the AMI project include modeling of human-human interaction, multimodal (speech and vision) recognition, content abstraction and human-computer interaction. The project collects data on people engaged in meetings in order to describe, analyze and theorize about meeting behaviour and collaborative work. The technologies that are being developed in the project deal with various interaction features, ranging from higher level features (e.g. dialogue acts, gestures, emotions) to lower level features (e.g. words, hand and arm movements, facial display elements). A critical issue for this research is the availability of large annotated databases. AMI builds on existing European expertise in the field of multimodal meeting modeling and annotation (M4, NITE, IM2). Coding schemes already exist (and have been tested) for annotating various aspects of behavior. These coding schemes (dialogue acts, emotion, meeting acts, gestures, focus of attention) are being improved and extended in AMI and new coding schemes for phenomena which have not been investigated yet (e.g. emotion) have been developed in the first year of the AMI project. This symposium treats the corpus collection, methods for user requirements
elicitation, the development of tools for annotation and the development
of a multi-purpose virtual meeting room. As the creation of a richly
annotated, extendable and reusable corpus of multimodal interactions
is expensive and time-consuming, tools have been designed to make the
annotation process more efficient. Each of these tools meet the properties
of a specific class of annotation problems. A virtual environment (VE)
has been developed for the purpose of modeling multi-party interaction
in meetings. The VE is a 3D virtual replica of one of the instrumented
meeting rooms. It is used for data visualization (which may eventually
lead to a 3D summary of real meetings), as an (immersive) instrument
for real time remote meeting participation, and as a device for research
in human interaction (as a VE gives control over various independent
factors and can be used to study how they influence measurable features
of behavior). Speakers:
Last updated: 19 October 2005 |