Combining audio-visual features for viewers' perception classification of Youtube car commercials

Thumbnail Image
Publication date
Defense date
Journal Title
Journal ISSN
Volume Title
International Speech Communication Association.
Google Scholar
Research Projects
Organizational Units
Journal Issue
In this paper, we present a computational model capable of predicting the viewer perception of Youtube car TV commercials by using a set of low-level audio and visual descriptors. Our research goal relies on the hypothesis that these descriptors could reflect to some extent the objective value of the videos and, in turn, the average viewer's perception. To that end, and as a novel approach to this problem, we automatically annotate our video corpus, grouped into 2 classes corresponding to differ-ent satisfaction levels, by means of a regular k-means algorithm applied to the video metadata related to users feedback. Evaluation results show that simple linear logistic regression models based on the 10 best visual descriptors and on the 10 best audio descriptors individually perform reasonably well, achieving a classification accuracy of roughly 70% and 75%, respectively. Combination of audio and visual descriptors yields better performance, roughly 86% for the top-20 selected from the entire descriptor set, but tipping the balance in favor of the audio ones (i.e. 17 vs 3). Audio content bigger influence in this domain is also evidenced by a side analysis of the video comments.
Proccedings of: 2nd International Workshop on Speech, Language and Audio in Multimedia. Penang, Malaysia, 11-12 September 2014.
Subjective assessment, Video aesthetics, Music Information Retrieval, Video metadata
Bibliographic citation
Tien-Ping Tan et al. (eds.) (2014). Proceeding of the 2nd International Workshop on Speech, Language and Audio in Multimedia (SLAM 2014), 11-12 September 2014, Penang, Malaysia. (pp. 14-18). International Speech Communication Association.