Publication:
Impact of visual design elements and principles in human electroencephalogram brain activity assessed with spectral methods and convolutional neural networks

dc.affiliation.dptoUC3M. Departamento de Biblioteconomía y Documentaciónes
dc.contributor.authorCabrera, Francisco E.
dc.contributor.authorSánchez-Núñez, Pablo
dc.contributor.authorVaccaro, Gustavo
dc.contributor.authorPeláez, José Ignacio
dc.contributor.authorEscudero, Javier
dc.date.accessioned2023-12-19T12:02:39Z
dc.date.available2023-12-19T12:02:39Z
dc.date.issued2021-07-09
dc.description.abstractThe visual design elements and principles (VDEPs) can trigger behavioural changes and emotions in the viewer, but their effects on brain activity are not clearly understood. In this paper, we explore the relationships between brain activity and colour (cold/warm), light (dark/bright), movement (fast/slow), and balance (symmetrical/asymmetrical) VDEPs. We used the public DEAP dataset with the electroencephalogram signals of 32 participants recorded while watching music videos. The characteristic VDEPs for each second of the videos were manually tagged for by a team of two visual communication experts. Results show that variations in the light/value, rhythm/movement, and balance in the music video sequences produce a statistically significant effect over the mean absolute power of the Delta, Theta, Alpha, Beta, and Gamma EEG bands (p < 0.05). Furthermore, we trained a Convolutional Neural Network that successfully predicts the VDEP of a video fragment solely by the EEG signal of the viewer with an accuracy ranging from 0.7447 for Colour VDEP to 0.9685 for Movement VDEP. Our work shows evidence that VDEPs affect brain activity in a variety of distinguishable ways and that a deep learning classifier can infer visual VDEP properties of the videos from EEG activity.en
dc.description.sponsorshipThis research was partially supported by On the Move, an international mobility programme organized by the Society of Spanish Researchers in the United Kingdom (SRUK) and CRUE Universidades Españolas. The Article Processing Charge (APC) was funded by the Programa Operativo Fondo Europeo de Desarrollo Regional (FEDER) Andalucía 2014–2020 under Grant UMA 18-FEDERJA-148 and Plan Nacional de I+D+i del Ministerio de Ciencia e Innovación-Gobierno de España (2021-2024) under Grant PID2020-115673RB-100.es
dc.identifier.bibliographicCitationCabrera, F.E.; Sánchez-Núñez, P.; Vaccaro, G.; Peláez, J.I.; Escudero, J. Impact of Visual Design Elements and Principles in Human Electroencephalogram Brain Activity Assessed with Spectral Methods and Convolutional Neural Networks. Sensors 2021, 21, 4695.es
dc.identifier.doihttps://doi.org/10.3390/s21144695
dc.identifier.issn1424-3210
dc.identifier.publicationfirstpage1
dc.identifier.publicationissue4695
dc.identifier.publicationlastpage22
dc.identifier.publicationtitleSensorsen
dc.identifier.publicationvolume21(14)
dc.identifier.urihttps://hdl.handle.net/10016/39114
dc.identifier.uxxiAR/0000033903
dc.language.isoenges
dc.publisherMDPIes
dc.relation.projectIDinfo:eu-repo/grantAgreement/EC/FEDER/UMA 18-FEDERJA-148es
dc.relation.projectIDGobierno de España. PID2020-115673RB-100.es
dc.rights© 2021 by the authorses
dc.rightsAtribución 3.0 España*
dc.rights.accessRightsopen accesses
dc.rights.urihttp://creativecommons.org/licenses/by/3.0/es/*
dc.subject.ecienciaBiblioteconomía y Documentaciónes
dc.subject.otherEEG
dc.subject.otheremotion classificationen
dc.subject.otherCNN
dc.subject.otherspectral analysisen
dc.subject.othervisual perceptionen
dc.subject.othervisual attentionen
dc.subject.othervisual featuresen
dc.subject.othervisual design elements and principles (VDEPs)en
dc.titleImpact of visual design elements and principles in human electroencephalogram brain activity assessed with spectral methods and convolutional neural networksen
dc.typeresearch article*
dc.type.hasVersionVoR*
dspace.entity.typePublication
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
impact_S_2021.pdf
Size:
2.76 MB
Format:
Adobe Portable Document Format
Description: