Perception in Multimodal Dialogue Systems

Perception in Multimodal Dialogue Systems
Author: Elisabeth Andre
Publisher: Springer Science & Business Media
Total Pages: 320
Release: 2008-06-11
Genre: Computers
ISBN: 3540693688

This book constitutes the refereed proceedings of the 4th IEEE Tutorial and Research Workshop on Perception and Interactive Technologies for Speech-Based Systems, PIT 2008, held in Kloster Irsee, Germany, in June 2008. The 37 revised full papers presented together with 1 invited keynote lecture were carefully selected from numerous submissions for inclusion in the book. The papers are organized in topical sections on multimodal and spoken dialogue systems, classification of dialogue acts and sound, recognition of eye gaze, head poses, mimics and speech as well as combinations of modalities, vocal emotion recognition, human-like and social dialogue systems, and evaluation methods for multimodal dialogue systems.

Advances in Natural Multimodal Dialogue Systems

Advances in Natural Multimodal Dialogue Systems
Author: Jan van Kuppevelt
Publisher: Springer Science & Business Media
Total Pages: 376
Release: 2006-06-28
Genre: Language Arts & Disciplines
ISBN: 1402039336

The main topic of this volume is natural multimodal interaction. The book is unique in that it brings together a great many contributions regarding aspects of natural and multimodal interaction written by many of the important actors in the field. Topics addressed include talking heads, conversational agents, tutoring systems, multimodal communication, machine learning, architectures for multimodal dialogue systems, systems evaluation, and data annotation.

9th International Workshop on Spoken Dialogue System Technology

9th International Workshop on Spoken Dialogue System Technology
Author: Luis Fernando D'Haro
Publisher: Springer Nature
Total Pages: 404
Release: 2019-09-24
Genre: Social Science
ISBN: 9811394431

This book presents the outcomes of the 9th International Workshop on Spoken Dialogue Systems (IWSDS), “Towards creating more human-like conversational agent technologies”. It compiles and provides a synopsis of current global research to push forward the state of the art in dialogue technologies, including advances in the context of the classical problems of language understanding, dialogue management and language generation, as well as cognitive topics related to the human nature of conversational phenomena, such as humor, empathy and social context understanding and awareness.

Spoken, Multilingual and Multimodal Dialogue Systems

Spoken, Multilingual and Multimodal Dialogue Systems
Author: Ramon Lopez Cozar Delgado
Publisher: John Wiley & Sons
Total Pages: 272
Release: 2007-01-11
Genre: Technology & Engineering
ISBN: 047002156X

Dialogue systems are a very appealing technology with an extraordinary future. Spoken, Multilingual and Multimodal Dialogues Systems: Development and Assessment addresses the great demand for information about the development of advanced dialogue systems combining speech with other modalities under a multilingual framework. It aims to give a systematic overview of dialogue systems and recent advances in the practical application of spoken dialogue systems. Spoken Dialogue Systems are computer-based systems developed to provide information and carry out simple tasks using speech as the interaction mode. Examples include travel information and reservation, weather forecast information, directory information and product order. Multimodal Dialogue Systems aim to overcome the limitations of spoken dialogue systems which use speech as the only communication means, while Multilingual Systems allow interaction with users that speak different languages. Presents a clear snapshot of the structure of a standard dialogue system, by addressing its key components in the context of multilingual and multimodal interaction and the assessment of spoken, multilingual and multimodal systems In addition to the fundamentals of the technologies employed, the development and evaluation of these systems are described Highlights recent advances in the practical application of spoken dialogue systems This comprehensive overview is a must for graduate students and academics in the fields of speech recognition, speech synthesis, speech processing, language, and human–computer interaction technolgy. It will also prove to be a valuable resource to system developers working in these areas.

The Structure of Multimodal Dialogue II

The Structure of Multimodal Dialogue II
Author: M. M. Taylor
Publisher: John Benjamins Publishing
Total Pages: 541
Release: 2000
Genre: Computers
ISBN: 9027221901

Most dialogues are multimodal. When people talk, they use not only their voices, but also facial expressions and other gestures, and perhaps even touch. When computers communicate with people, they use pictures and perhaps sounds, together with textual language, and when people communicate with computers, they are likely to use mouse gestures almost as much as words. How are such multimodal dialogues constructed? This is the main question addressed in this selection of papers of the second Venaco Workshop, sponsored by the NATO Research Study Group RSG-10 on Automatic Speech Processing, and by the European Speech Communication Association (ESCA).

Simulation-Based Usability Evaluation of Spoken and Multimodal Dialogue Systems

Simulation-Based Usability Evaluation of Spoken and Multimodal Dialogue Systems
Author: Stefan Hillmann
Publisher: Springer
Total Pages: 262
Release: 2017-11-23
Genre: Technology & Engineering
ISBN: 3319625187

This book describes an extension of the user behaviour simulation (UBS) of an existing tool for automatic usability evaluation (AUE). This extension is based upon a user study with a smart home system. It uses technical-sociological methods for the execution of the study and the analysis of the collected data. A comparison of the resulting UBS with former UBSs, as well as the empirical data, shows that the new simulation approach outperforms the former simulation. The improvement affects the prediction of dialogue metrics that are related to dialogue efficiency and dialogue effectiveness. Furthermore, the book describes a parameter-based data model, as well as a related framework. Both are used to uniformly describe multimodal human-computer interactions and to provide such descriptions for usability evaluations. Finally, the book proposes a new two-stage method for the evaluation of UBSs. The method is based on the computation of a distance measures between two dialogue corpora and the pair-wise comparison of distances among several dialogue corpora.

SmartKom: Foundations of Multimodal Dialogue Systems

SmartKom: Foundations of Multimodal Dialogue Systems
Author: Wolfgang Wahlster
Publisher: Springer Science & Business Media
Total Pages: 639
Release: 2006-09-05
Genre: Computers
ISBN: 3540366784

With contributions by leading scientists in the field, this book gives the first comprehensive overview of the results of the seminal SmartKom project – one of the most advanced multimodal dialogue systems worldwide.

The Oxford Handbook of Computational Linguistics

The Oxford Handbook of Computational Linguistics
Author: Ruslan Mitkov
Publisher: Oxford University Press
Total Pages: 1377
Release: 2022-06-02
Genre: Language Arts & Disciplines
ISBN: 019162554X

Ruslan Mitkov's highly successful Oxford Handbook of Computational Linguistics has been substantially revised and expanded in this second edition. Alongside updated accounts of the topics covered in the first edition, it includes 17 new chapters on subjects such as semantic role-labelling, text-to-speech synthesis, translation technology, opinion mining and sentiment analysis, and the application of Natural Language Processing in educational and biomedical contexts, among many others. The volume is divided into four parts that examine, respectively: the linguistic fundamentals of computational linguistics; the methods and resources used, such as statistical modelling, machine learning, and corpus annotation; key language processing tasks including text segmentation, anaphora resolution, and speech recognition; and the major applications of Natural Language Processing, from machine translation to author profiling. The book will be an essential reference for researchers and students in computational linguistics and Natural Language Processing, as well as those working in related industries.

Multimodality in Language and Speech Systems

Multimodality in Language and Speech Systems
Author: Björn Granström
Publisher: Springer Science & Business Media
Total Pages: 264
Release: 2013-04-17
Genre: Computers
ISBN: 9401723672

This book is based on contributions to the Seventh European Summer School on Language and Speech Communication that was held at KTH in Stockholm, Sweden, in July of 1999 under the auspices of the European Language and Speech Network (ELSNET). The topic of the summer school was "Multimodality in Language and Speech Systems" (MiLaSS). The issue of multimodality in interpersonal, face-to-face communication has been an important research topic for a number of years. With the increasing sophistication of computer-based interactive systems using language and speech, the topic of multimodal interaction has received renewed interest both in terms of human-human interaction and human-machine interaction. Nine lecturers contri buted to the summer school with courses on specialized topics ranging from the technology and science of creating talking faces to human-human communication, which is mediated by computer for the handicapped. Eight of the nine lecturers are represented in this book. The summer school attracted more than 60 participants from Europe, Asia and North America representing not only graduate students but also senior researchers from both academia and industry.