Publication:
Evaluation of an Algorithm for Automatic Grading of Forum Messages in MOOC Discussion Forums

Simple item page
dc.affiliation.dptoUC3M. Departamento de Ingeniería Telemáticaes
dc.affiliation.grupoinvUC3M. Grupo de Investigación: Aplicaciones y Servicios Telemáticos (GAST)es
dc.contributor.authorPerez Nicolas, Raquel Lucia
dc.contributor.authorAlario-Hoyos, Carlos
dc.contributor.authorEstévez Ayres, Iria Manuela
dc.contributor.authorMoreno-Marcos, Pedro Manuel
dc.contributor.authorMuñoz Merino, Pedro José
dc.contributor.authorDelgado Kloos, Carlos
dc.contributor.funderComunidad de Madrides
dc.contributor.funderMinisterio de Ciencia, Innovación y Universidades (España)es
dc.date.accessioned2021-09-22T09:21:17Z
dc.date.available2021-09-22T09:21:17Z
dc.date.issued2021-08-02
dc.descriptionThis article belongs to the Special Issue E-learning, Digital Learning, and Digital Communication Used for Education Sustainability.en
dc.description.abstractDiscussion forums are a valuable source of information in educational platforms such as Massive Open Online Courses (MOOCs), as users can exchange opinions or even help other students in an asynchronous way, contributing to the sustainability of MOOCs even with low interaction from the instructor. Therefore, the use of the forum messages to get insights about students’ performance in a course is interesting. This article presents an automatic grading approach that can be used to assess learners through their interactions in the forum. The approach is based on the combination of three dimensions: (1) the quality of the content of the interactions, (2) the impact of the interactions, and (3) the user’s activity in the forum. The evaluation of the approach compares the assessment by experts with the automatic assessment obtaining a high accuracy of 0.8068 and Normalized Root Mean Square Error (NRMSE) of 0.1799, which outperforms previous existing approaches. Future research work can try to improve the automatic grading by the training of the indicators of the approach depending on the MOOCs or the combination with text mining techniques.es
dc.description.sponsorshipThis research was funded by the FEDER/Ministerio de Ciencia, Innovación y Universidades-Agencia Estatal de Investigación, through the Smartlet and H2O Learn Projects under Grants TIN2017-85179-C3-1-R and PID2020-112584RB-C31, and in part by the Madrid Regional Government through the e-Madrid-CM Project under Grant S2018/TCS-4307 and under the Multiannual Agreement with UC3M in the line of Excellence of University Professors (EPUC3M21), and in the context of the V PRICIT (Regional Programme of Research and Technological Innovation), a project which is co-funded by the European Structural Funds (FSE and FEDER). Partial support has also been received from the European Commission through Erasmus+ Capacity Building in the Field of Higher Education projects, more specifically through projects InnovaT (598758-EPP-1-2018-1-AT-EPPKA2-CBHE-JP), and PROF-XXI (609767-EPP-1-2019-1-ES-EPPKA2-CBHE-JP).en
dc.format.extent18
dc.identifier.bibliographicCitationPérez-Nicolás, R. L., Alario-Hoyos, C., Estévez-Ayres, I., Moreno-Marcos, P. M., Muñoz-Merino, P. J. & Delgado Kloos, C. (2021). Evaluation of an Algorithm for Automatic Grading of Forum Messages in MOOC Discussion Forums. Sustainability, 13(16), 9364.en
dc.identifier.doihttps://doi.org/10.3390/su13169364
dc.identifier.issn2071-1050
dc.identifier.publicationfirstpage9364
dc.identifier.publicationissue16
dc.identifier.publicationtitleSustainabilityen
dc.identifier.publicationvolume13
dc.identifier.urihttps://hdl.handle.net/10016/33301
dc.identifier.uxxiAR/0000028395
dc.language.isoeng
dc.publisherMDPI
dc.relation.projectIDGobierno de España. TIN2017-85179-C3-1-Res
dc.relation.projectIDComunidad de Madrid. S2018/TCS-4307es
dc.relation.projectIDGobierno de España. PID2020-112584RB-C31es
dc.rights© 2021 by the authors.en
dc.rightsAtribución 3.0 España*
dc.rights.accessRightsopen accessen
dc.rights.urihttp://creativecommons.org/licenses/by/3.0/es/*
dc.subject.ecienciaTelecomunicacioneses
dc.subject.otherMOOCen
dc.subject.otherDiscussion forumen
dc.subject.otherAutomatic gradingen
dc.subject.otherEvaluationen
dc.subject.otherInteractionsen
dc.subject.otherQualityen
dc.subject.otherImpacten
dc.titleEvaluation of an Algorithm for Automatic Grading of Forum Messages in MOOC Discussion Forumsen
dc.typeresearch article*
dc.type.hasVersionVoR*
dspace.entity.typePublication
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Evaluation_Sustainability_2021.pdf
Size:
856.48 KB
Format:
Adobe Portable Document Format
Download
Collections
DIT - GAST - Artículos de Revistas