The Paradigm Shift to Multimodality in Contemporary Computer Interfaces

Preface: Intended Audience and Teaching with this Book.- Acknowledgments.- Introduction.- Definition and Typre of Multimodal Interface.- History of Paradigm Shift from Graphical to Multimodal Interfaces.- Aims and Advantages of Multimodal Interfaces.- Evolutionary, Neuroscience, and Cognitive Foundations of Multimodal Interfaces.- Theoretical Foundations of Multimodal Interfaces.- Human-Centered Design of Multimodal Interfaces.- Multimodal Signal Processing, Fusion, and Architectures.- Multimodal Language, Semantic Processing, and Multimodal Integration.- Commercialization of Multimodal Interfaces.- Emerging Multimodal Research Areas, and Applications.- Beyond Multimodality: Designing More Expressively Powerful Interfaces.- Conclusions and Future Directions.- Bibliography.- Author Biographies.

Dr. Sharon Oviatt is well known for her extensive work in multi-modal and mobile interfaces, human-centered interface designs, educational interfaces, and communications interfaces. She was the recipient of the Inaugural ACM ICMI Sustained Accomplishment Award and a National Science Foundation Special Creativity Award for her pioneering research on mobile multimodal interfaces. She is also a member of the CHI Academy. Dr. Oviatt has published over 150 scientific articles in a multidisciplinary range of venues, including computer science, learning and cognitive sciences, and linguistic sciences. She is an Associate Editor of the main journals and edited book collections in the field of human interfaces, and authored the chapter on ""Multimodal Interfaces"" in The Human-Computer Interaction Handbook, 3rd Edition. She was a founder of the International Conference on Multimodal Interfaces (ICMI), which became an annual ACM-sponsored international conference series under her guidance.Dr. Philip R Cohen is internationally known for his work in multimodal systems and artificial intelligence (intelligent agents and natural language processing). He is a Fellow of the Association for the Advancement of Artificial Intelligence, and past President of the Association for Computational Linguistics. He has over 120 refereed publications in a wide range of venues, and is the recipient (with Prof. Hector Levesque) of an inaugural Influential Paper award by the International Foundation for Autonomous Agents and Multi-Agent Systems. Cohen is currently Vice President, Advanced Technologies at VoiceBox Technologis, Inc. His prior positions include being Founder and Executive Vice President of Research at Adapx Inc., professor and co-director of the Center for Human-Computer Communication in the Department of Computer Science and Engineering at the Oregon Health and Science University, and a Senior Computer Scientist and Director of the Natural Language Program in the Artificial