Publication: A Proposal for New Evaluation Metrics and Result Visualization Technique for Sentiment Analysis Tasks
Loading...
Identifiers
ISSN: 978-3-642-40801-4 (print)
ISSN: 978-3-642-40802-1 (online)
ISSN: 0302-9743 (print)
ISSN: 1611-3349 (online)
UXXI: CC/0000020970
Publication date
2013
Defense date
Advisors
Tutors
Journal Title
Journal ISSN
Volume Title
Publisher
Springer
Abstract
In this paper we propound the use of a number of entropybased metrics and a visualization tool for the intrinsic evaluation of Sentiment and Reputation Analysis tasks. We provide a theoretical justification for their use and discuss how they complement other accuracybased metrics. We apply the proposed techniques to the analysis of TASS-SEPLN and RepLab 2012 results and show how the metric is effective for system comparison purposes, for system development and postmortem evaluation.
Description
Proceedings of: 4th International Conference of the CLEF Initiative (CLEF 2013). 4th International Conference of the CLEF Initiative (CLEF 2013). Valencia, Spain,
September 23-26, 2013.
Keywords
Sentiment Analysis, Reputation Analysis, Evaluation Metrics, Normalized Information Transfer, Entropy-Modified Accuracy
Bibliographic citation
Forner, P., et al. (eds.) (2013). Information Access Evaluation. Multilinguality, Multimodality, and Visualization: 4th International Conference of the CLEF Initiative, CLEF 2013, Valencia, Spain, September 23-26, 2013. Proceedings. (pp. 41-52). (Lecture Notes in Computer Science; 8138). Springer Berlin Heidelberg.