Spoken Multimodal Human-Computer Dialogue in Mobile Environments

I. Issues in Multimodal Spoken Dialogue Systems and Components

1. Multimodal Dialogue Systems
Alexander I. Rudnicky

2. Speech Recognition Technology in Multimodal/Ubiquitous Computing Environments
Sadaoki Furui

3. A Robust Multimodal Speech Recognition Method using Optical Flow Analysis
Satoshi Tamura, Koji Iwano, Sadaoki Furui

4. Feature Functions for Tree-Based Dialogue Course Management
Klaus Macherey, Hermann Ney

5. A Reasoning Component for Information-Seeking and Planning Dialogues
Dirk Bühler, Wolfgang Minker

6. A Model for Multimodal Dialogue System Output Applied to an Animated Talking Head
Jonas Beskow, Jens Edlund, Magnus Nordstrand

II. System Architecture and Example Implemesntations

7. Overview of System Architecture
Andreas Kellner

8. XISL: A Modality-Independent MMI Description Language
Kouichi Katsurada, Hirobumi Yamada, Yusaku Nakamura, Satoshi Kobayashi, Tsuneo Nitta

9. A Path to Multimodal Data Services for Telecommunications
Georg Niklfeld, Michael Pucher, Robert Finan, Wolfgang Eckhart

10. Multimodal Spoken Dialogue with Wireless Devices
24|25|Roberto Pieraccini, 24|26|†Bob Carpentert, 24|27|‡Eric Woudenberg, 24|25|Sasha Caskey, Stephen Springer, Jonathan Bloom, Michael Phillips

11. The Smartkom Mobile Car Prototype System for Flexible Human-Machine Communication
Dirk Bühler, Wolfgang Minker

12. LARRI: A Language-Based Maintenance and Repair Assistant
Dan Bohus, Alexander I. Rudnicky

III. Evaluation and Usability

13. Overview of Evaluation and Usability
Laila Dybkjær, Niels Ole Bernsen, Wolfgang Minker

14. Evaluating Dialogue Strategies in Multimodal Dialogue Systems
Steve Whittaker, Marilyn Walker

15. Enhancing the Usability of Multimodal Virtual Co-drivers
Niels Ole Bernsen, Laila Dybkjaer

16. Design, Implementation and Evaluation of the SENECA Spoken Language Dialogue System
Wolfgang Minker, Udo Haiber, Paul Heisterkamp, Sven Scheible

17. Segmenting Route Descriptions for Mobile Devices
Sabine Geldof, Robert Dale

18. Effects of Prolonged Use on the Usability of a Multimodal Form-Filling Interface
Janienke Sturm, Bert Cranen, Jacques Terken, Ilse Bakx

19. User Multitasking with Mobile Multimodal Systems
Anthony Jameson, Kerstin Klöckner

20. Speech Convergence with Animated Personas
Sharon Oviatt, Courtney Darves, Rachel Coulston, Matt Wesson

Keywords: Linguistics, Computational Linguistics, Multimedia Information Systems, User Interfaces and Human Computer Interaction, Language Translation and Linguistics