Publication:
A Proposal for New Evaluation Metrics and Result Visualization Technique for Sentiment Analysis Tasks

Loading...
Thumbnail Image
Identifiers
ISSN: 978-3-642-40801-4 (print)
ISSN: 978-3-642-40802-1 (online)
ISSN: 0302-9743 (print)
ISSN: 1611-3349 (online)
Publication date
2013
Defense date
Advisors
Tutors
Journal Title
Journal ISSN
Volume Title
Publisher
Springer
Impact
Google Scholar
Export
Research Projects
Organizational Units
Journal Issue
Abstract
In this paper we propound the use of a number of entropybased metrics and a visualization tool for the intrinsic evaluation of Sentiment and Reputation Analysis tasks. We provide a theoretical justification for their use and discuss how they complement other accuracybased metrics. We apply the proposed techniques to the analysis of TASS-SEPLN and RepLab 2012 results and show how the metric is effective for system comparison purposes, for system development and postmortem evaluation.
Description
Proceedings of: 4th International Conference of the CLEF Initiative (CLEF 2013). 4th International Conference of the CLEF Initiative (CLEF 2013). Valencia, Spain, September 23-26, 2013.
Keywords
Sentiment Analysis, Reputation Analysis, Evaluation Metrics, Normalized Information Transfer, Entropy-Modified Accuracy
Bibliographic citation
Forner, P., et al. (eds.) (2013). Information Access Evaluation. Multilinguality, Multimodality, and Visualization: 4th International Conference of the CLEF Initiative, CLEF 2013, Valencia, Spain, September 23-26, 2013. Proceedings. (pp. 41-52). (Lecture Notes in Computer Science; 8138). Springer Berlin Heidelberg.