Publication: Processing and fusioning multiple heterogeneous information sources in multimodal dialog systems
Loading...
Identifiers
Publication date
2014
Defense date
Authors
Advisors
Tutors
Journal Title
Journal ISSN
Volume Title
Publisher
Ieee - The Institute Of Electrical And Electronics Engineers, Inc
Impact
Export
Abstract
Context-aware dialog systems must be able to process very heterogeneous information sources and user input modes. In this paper we propose a method to fuse multimodal inputs into a unified representation. This representation allows the dialog manager of the system to find the best interaction strategy and also select the next system response. We show the applicability of our proposal by means of the implementation of a dialog system that considers spoken, tactile, and also information related to the context of the interaction with its users. Context information is related to the detection of user's intention during the dialog and their emotional state (internal context), and the user's location (external context).
Description
Proceedings of: 17th International Conference on Information Fusion (FUSION 2014): Salamanca, Spain 7-10 July 2014.
Keywords
Context-aware dialog system, Emotional state, Multimodal dialog system, Multiple heterogeneous information sources
Bibliographic citation
Corchado, J. M., et al. (Eds.) (2014). 17th International Conference on Information Fusion (FUSION 2014): Salamanca, Spain 7-10 July 2014. IEEE.