Multimodal Corpora: Models Of Human Behaviour For The Specification And Evaluation Of Multimodal Input And Output Interfaces

J.-C. Martin, E.D. Os, P. Kühnlein, L. Boves, P. Paggio, and R. Catizone

25 May 2004, Lisbon, Portugal

The workshop Multimodal Corpora: Models Of Human Behaviour For The Specification And Evaluation Of Multimodal Input And Output Interfaces was held at the 4th International Conference for Language Resources and Evaluation (LREC-08).

Download workshop proceedings

Programme

09:00 Welcome

Recommendations for Multimodal Annotation Tools and Schemes

09:15 A System for Situated Temporal Analysis of Multimodal Communication (Yang Shi, Travis Rose and Francis Quek)

09:45 Recommendations for Natural Interactivity and Multimodal Annotation Schemes (Laila Dybkjær, Niels Ole Bernsen)

Multimodal Systems Design and Evaluation

10:15 A Multimodal Corpus Collection System for Mobile Applications (Knut Kvale, Jan Eikeset Knudsen, and John Rugelbak)

10:45 Evaluation of multimodal dialog systems (Louis Vuurpijl, Louis ten Bosch, Stéphane Rossignol, Andre Neumann, Norbert Pfleger, Ralf Engel)

11:15 – 11:30 : Coffee break

Multimodal Systems Design and Evaluation

11:30 Measuring Relative Target User Group Success in Spoken Conversation for Edutainment Applications (Niels Ole Bernsen)

12:00 Describing children’s intuitive movements in a perceptive adventure game (Johanna Höysniemi, Perttu Hämäläinen)

12:30 – 13:15 : Discussion

13:15 – 14:30 : Lunch

Invited Talk

14:30 Corpora for Sign Language Studies (Annelies Braffort)

Coding Schemes and Multimodal Communication

15:15 A coding scheme for the annotation of feedback phenomena in conversational speech (Loredana Cerrato)

15:45 – 16:15 : Coffee break

16:15 Multimodal Score: an ANVIL Based Annotation Scheme for Multimodal Audio-Video Analysis (Emanuela Magno Caldognetto, Isabella Poggi, Piero Cosi, Federica Cavicchio, G. Merola)

16:45 The Swedish PF-Star Multimodal Corpora (Jonas Beskow, Loredana Cerrato, Björn Granström, David House, Magnus Nordstrand, Gunilla Svanfeldt)

17:15 On the primacy of language in multimodal communication (Jan Peter de Ruiter)

17:45 – 18:30 : Panel discussion

18:30 : End of workshop

Organization

Organising Committee

Jean-Claude MARTIN, LIMSI-CNRS
Elisabeth Den OS, MPI
Peter KÜHNLEIN, Univ. Bielefeld
Lou BOVES, Univ. Of Nijmegen
Patrizia PAGGIO, CST
Roberta CATIZONE, Univ. Sheffield

Programme Committee

Elisabeth Ahlsén Univ. Göteborg
Jens Allwood Univ. Göteborg
Elisabeth André Univ. Augsburg
Niels Ole Bernsen NIS Lab
Lou Boves Univ. Nijmegen
Stéphanie Buisine LIMSI-CNRS
Roberta Catizone Univ. Sheffield
Loredana Cerrato TMH-CTT
Piero Cosi ISTC-SPFD CNR
Jan-Peter de Ruiter MPI
Els den Os MPI
Laila Dybkjær NIS Lab
David Horowitz Vox Generation
Bart Jongejan CST
Alfred Kranstedt SFB 360
Steven Krauwer Univ. Utrecht
Peter Kühnlein SFB 360
Knut Kvale Telenor R&D
Myriam Lamolle LINC-IUT
Joseph Mariani LIMSI-CNRS
Jean-Claude Martin LIMSI-CNRS
Jan-Torsten Milde FH Aalen
Sharon Oviatt CHCC
Patrizia Paggio CST
Catherine Pelachaud Univ. Paris
Janienke Sturm Univ. Nijmegen


maintained by kipp