Search CALO Publications:

Author and Title
Edward C. Kaiser, P. Barthelmess, Alexander Arthur. Multimodal Play Back of Collaborative Multiparty Corpora. Workshop Proceedings of the Seventh International Conference on Multimodal Interfaces (ICMI 2005), Oct. 7, 2005, Trento, Italy.

Abstract
A basic capability driving the development of systems is the ability to execute multiple versions of a system against the same set of data. That is essential for instance to verify that coding problems were corrected, to provide guarantees that changes to the code did not introduce errors (regression testing) and for comparison of performance among different algorithmic
solutions.

Multimodal systems process a combination of inputs and their results are susceptible to timing issues, which determine for instance whether a pair of inputs from different modalities combine or not. When a multimodal system is executed against corpus data, it becomes necessary to synchronize processing of the various input streams and to handle time-related information so as to emulate real-time execution. This is particularly complex when multiple components of the various input stream processors take longer than real-time. In this paper we describe a multimodal play back mechanism that addresses these problems.

We report on two data collection and play back software and hardware environments — one used for system development and evaluation and the other used for supporting manual annotation of multimodal data.

Download