Publication:
Practical evaluation of VMAF perceptual video quality for WebRTC applications

dc.affiliation.dptoUC3M. Departamento de Ingeniería Telemáticaes
dc.affiliation.grupoinvUC3M. Grupo de Investigación: Aplicaciones y Servicios Telemáticos (GAST)es
dc.contributor.authorGarcía Gutiérrez, Boni
dc.contributor.authorLópez-Fernández, Luis
dc.contributor.authorGortázar, Francisco
dc.contributor.authorGallego, Micael
dc.contributor.funderMinisterio de Economía y Competitividad (España)es
dc.contributor.funderComunidad de Madrides
dc.contributor.funderEuropean Commissionen
dc.date.accessioned2021-04-15T10:57:19Z
dc.date.available2021-04-15T10:57:19Z
dc.date.issued2019-08
dc.description.abstractWebRTC is the umbrella term for several emergent technologies aimed to exchange real-time media in the Web. Like other media-related services, the perceived quality of WebRTC communication can be measured using Quality of Experience (QoE) indicators. QoE assessment methods can be classified as subjective (users' evaluation scores) or objective (models computed as a function of different parameters). In this paper, we focus on VMAF (Video Multi-method Assessment Fusion), which is an emergent full-reference objective video quality assessment model developed by Netflix. VMAF is typically used to assess video streaming services. This paper evaluates the use of VMAF in a different type of application: WebRTC. To that aim, we present a practical use case built on the top of well-known open source technologies, such as JUnit, Selenium, Docker, and FFmpeg. In addition to VMAF, we also calculate other objective QoE video metrics such as Visual Information Fidelity in the pixel domain (VIFp), Structural Similarity (SSIM), or Peak Signal-to-Noise Ratio (PSNR) applied to a WebRTC communication in different network conditions in terms of packet loss. Finally, we compare these objective results with a subjective evaluation using a Mean Opinion Score (MOS) scale to the same WebRTC streams. As a result, we found a strong correlation of the subjective video quality perceived in WebRTC video calls with the objective results computed with VMAF and VIFp in comparison with SSIM and PSNR and their variants.en
dc.description.sponsorshipThis work has been supported by the European Commission under project ElasTest (H2020-ICT-10-2016, GA-731535); by the Regional Government of Madrid (CM) under project EDGEDATA-CM (P2018/TCS-4499) cofunded by FSE and FEDER; by the Spanish Government under projects LERNIM (RTC-2016-4674-7) and BugBirth (RTI2018-101963-B-I00) cofunded by the Ministry of Economy and Competitiveness, FEDER and AEI.en
dc.format.extent15
dc.identifier.bibliographicCitationGarcía B.,López Fernández L., Gortázar F. & Gallego M. (2019). Practical evaluation of VMAF perceptual video quality for WebRTC applications. Electronics 2019, 8(8), 854.es
dc.identifier.doihttps://doi.org/10.3390/electronics8080854
dc.identifier.issn2079-9292
dc.identifier.publicationfirstpage1
dc.identifier.publicationissue8
dc.identifier.publicationlastpage15
dc.identifier.publicationtitleElectronicsen
dc.identifier.publicationvolume8
dc.identifier.urihttps://hdl.handle.net/10016/32367
dc.identifier.uxxiAR/0000026603
dc.language.isoeng
dc.publisherMDPI
dc.relation.projectIDComunidad de Madrid. P2018/TCS-4499es
dc.relation.projectIDGobierno de España. RTI2018-101963-B-I00es
dc.relation.projectIDGobierno de España. RTC-2016-4674-7es
dc.relation.projectIDinfo:eu-repo/grantAgreement/EC/H2020/731535
dc.rights© 2019 by the authors.en
dc.rightsAtribución 3.0 España*
dc.rights.accessRightsopen access
dc.rights.urihttp://creativecommons.org/licenses/by/3.0/es/*
dc.subject.ecienciaTelecomunicacioneses
dc.subject.otherQoEen
dc.subject.otherWebRTCen
dc.subject.otherVMAFen
dc.subject.otherVideo qualityen
dc.titlePractical evaluation of VMAF perceptual video quality for WebRTC applicationsen
dc.typeresearch article*
dc.type.hasVersionVoR*
dspace.entity.typePublication
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Practical_Electronics_2019.pdf
Size:
1.34 MB
Format:
Adobe Portable Document Format