RT Journal Article
T1 Evaluation of an Algorithm for Automatic Grading of Forum Messages in MOOC Discussion Forums
A1 Perez Nicolas, Raquel Lucia
A1 Alario-Hoyos, Carlos
A1 Estévez Ayres, Iria Manuela
A1 Moreno-Marcos, Pedro Manuel
A1 Muñoz Merino, Pedro José
A1 Delgado Kloos, Carlos
AB Discussion forums are a valuable source of information in educational platforms such as Massive Open Online Courses (MOOCs), as users can exchange opinions or even help other students in an asynchronous way, contributing to the sustainability of MOOCs even with low interaction from the instructor. Therefore, the use of the forum messages to get insights about students’ performance in a course is interesting. This article presents an automatic grading approach that can be used to assess learners through their interactions in the forum. The approach is based on the combination of three dimensions: (1) the quality of the content of the interactions, (2) the impact of the interactions, and (3) the user’s activity in the forum. The evaluation of the approach compares the assessment by experts with the automatic assessment obtaining a high accuracy of 0.8068 and Normalized Root Mean Square Error (NRMSE) of 0.1799, which outperforms previous existing approaches. Future research work can try to improve the automatic grading by the training of the indicators of the approach depending on the MOOCs or the combination with text mining techniques.
PB MDPI
SN 2071-1050
YR 2021
FD 2021-08-02
LK https://hdl.handle.net/10016/33301
UL https://hdl.handle.net/10016/33301
LA eng
NO This article belongs to the Special Issue E-learning, Digital Learning, and Digital Communication Used for Education Sustainability.
NO This research was funded by the FEDER/Ministerio de Ciencia, Innovación y Universidades-Agencia Estatal de Investigación, through the Smartlet and H2O Learn Projects under Grants TIN2017-85179-C3-1-R and PID2020-112584RB-C31, and in part by the Madrid Regional Government through the e-Madrid-CM Project under Grant S2018/TCS-4307 and under the Multiannual Agreement with UC3M in the line of Excellence of University Professors (EPUC3M21), and in the context of the V PRICIT (Regional Programme of Research and Technological Innovation), a project which is co-funded by the European Structural Funds (FSE and FEDER). Partial support has also been received from the European Commission through Erasmus+ Capacity Building in the Field of Higher Education projects, more specifically through projects InnovaT (598758-EPP-1-2018-1-AT-EPPKA2-CBHE-JP), and PROF-XXI (609767-EPP-1-2019-1-ES-EPPKA2-CBHE-JP).
DS e-Archivo
RD 1 sept. 2024