Publication:
A novel approach for data fusion and dialog management in user-adapted multimodal dialog systems

Loading...
Thumbnail Image
Identifiers
ISBN: 978-84-9012-355-3
Publication date
2014
Defense date
Advisors
Tutors
Journal Title
Journal ISSN
Volume Title
Publisher
Ieee - The Institute Of Electrical And Electronics Engineers, Inc
Impact
Google Scholar
Export
Research Projects
Organizational Units
Journal Issue
Abstract
Multimodal dialog systems have demonstrated a high potential for more flexible, usable and natural humancomputer interaction. These improvements are highly dependent on the fusion and dialog management processes, which respectively integrates and interprets multimedia multimodal information and decides the next system response for the current dialog state. In this paper we propose to carry out the multimodal fusion and dialog management processes at the dialog level in a single step. To do this, we describe an approach based on a statistical model that takes user's intention into account, generates a single representation obtained from the different input modalities and their confidence scores, and selects the next system action based on this representation. The paper also describes the practical application of the proposed approach to develop a multimodal dialog system providing travel and tourist information.
Description
Proceedings of: 17th International Conference on Information Fusion (FUSION 2014): Salamanca, Spain 7-10 July 2014.
Keywords
Human computer interaction, Interactive systems, Multimedia systems, Sensor fusion, Statistical analysis, Travel industry
Bibliographic citation
Corchado, J. M., et al. (Eds.) (2014). 17th International Conference on Information Fusion (FUSION 2014): Salamanca, Spain 7-10 July 2014. IEEE.