Publication: Evaluation of an Algorithm for Automatic Grading of Forum Messages in MOOC Discussion Forums
dc.affiliation.dpto | UC3M. Departamento de Ingeniería Telemática | es |
dc.affiliation.grupoinv | UC3M. Grupo de Investigación: Aplicaciones y Servicios Telemáticos (GAST) | es |
dc.contributor.author | Perez Nicolas, Raquel Lucia | |
dc.contributor.author | Alario-Hoyos, Carlos | |
dc.contributor.author | Estévez Ayres, Iria Manuela | |
dc.contributor.author | Moreno-Marcos, Pedro Manuel | |
dc.contributor.author | Muñoz Merino, Pedro José | |
dc.contributor.author | Delgado Kloos, Carlos | |
dc.contributor.funder | Comunidad de Madrid | es |
dc.contributor.funder | Ministerio de Ciencia, Innovación y Universidades (España) | es |
dc.date.accessioned | 2021-09-22T09:21:17Z | |
dc.date.available | 2021-09-22T09:21:17Z | |
dc.date.issued | 2021-08-02 | |
dc.description | This article belongs to the Special Issue E-learning, Digital Learning, and Digital Communication Used for Education Sustainability. | en |
dc.description.abstract | Discussion forums are a valuable source of information in educational platforms such as Massive Open Online Courses (MOOCs), as users can exchange opinions or even help other students in an asynchronous way, contributing to the sustainability of MOOCs even with low interaction from the instructor. Therefore, the use of the forum messages to get insights about students’ performance in a course is interesting. This article presents an automatic grading approach that can be used to assess learners through their interactions in the forum. The approach is based on the combination of three dimensions: (1) the quality of the content of the interactions, (2) the impact of the interactions, and (3) the user’s activity in the forum. The evaluation of the approach compares the assessment by experts with the automatic assessment obtaining a high accuracy of 0.8068 and Normalized Root Mean Square Error (NRMSE) of 0.1799, which outperforms previous existing approaches. Future research work can try to improve the automatic grading by the training of the indicators of the approach depending on the MOOCs or the combination with text mining techniques. | es |
dc.description.sponsorship | This research was funded by the FEDER/Ministerio de Ciencia, Innovación y Universidades-Agencia Estatal de Investigación, through the Smartlet and H2O Learn Projects under Grants TIN2017-85179-C3-1-R and PID2020-112584RB-C31, and in part by the Madrid Regional Government through the e-Madrid-CM Project under Grant S2018/TCS-4307 and under the Multiannual Agreement with UC3M in the line of Excellence of University Professors (EPUC3M21), and in the context of the V PRICIT (Regional Programme of Research and Technological Innovation), a project which is co-funded by the European Structural Funds (FSE and FEDER). Partial support has also been received from the European Commission through Erasmus+ Capacity Building in the Field of Higher Education projects, more specifically through projects InnovaT (598758-EPP-1-2018-1-AT-EPPKA2-CBHE-JP), and PROF-XXI (609767-EPP-1-2019-1-ES-EPPKA2-CBHE-JP). | en |
dc.format.extent | 18 | |
dc.identifier.bibliographicCitation | Pérez-Nicolás, R. L., Alario-Hoyos, C., Estévez-Ayres, I., Moreno-Marcos, P. M., Muñoz-Merino, P. J. & Delgado Kloos, C. (2021). Evaluation of an Algorithm for Automatic Grading of Forum Messages in MOOC Discussion Forums. Sustainability, 13(16), 9364. | en |
dc.identifier.doi | https://doi.org/10.3390/su13169364 | |
dc.identifier.issn | 2071-1050 | |
dc.identifier.publicationfirstpage | 9364 | |
dc.identifier.publicationissue | 16 | |
dc.identifier.publicationtitle | Sustainability | en |
dc.identifier.publicationvolume | 13 | |
dc.identifier.uri | https://hdl.handle.net/10016/33301 | |
dc.identifier.uxxi | AR/0000028395 | |
dc.language.iso | eng | |
dc.publisher | MDPI | |
dc.relation.projectID | Gobierno de España. TIN2017-85179-C3-1-R | es |
dc.relation.projectID | Comunidad de Madrid. S2018/TCS-4307 | es |
dc.relation.projectID | Gobierno de España. PID2020-112584RB-C31 | es |
dc.rights | © 2021 by the authors. | en |
dc.rights | Atribución 3.0 España | * |
dc.rights.accessRights | open access | en |
dc.rights.uri | http://creativecommons.org/licenses/by/3.0/es/ | * |
dc.subject.eciencia | Telecomunicaciones | es |
dc.subject.other | MOOC | en |
dc.subject.other | Discussion forum | en |
dc.subject.other | Automatic grading | en |
dc.subject.other | Evaluation | en |
dc.subject.other | Interactions | en |
dc.subject.other | Quality | en |
dc.subject.other | Impact | en |
dc.title | Evaluation of an Algorithm for Automatic Grading of Forum Messages in MOOC Discussion Forums | en |
dc.type | research article | * |
dc.type.hasVersion | VoR | * |
dspace.entity.type | Publication |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- Evaluation_Sustainability_2021.pdf
- Size:
- 856.48 KB
- Format:
- Adobe Portable Document Format