An algorithm and a tool for the automatic grading of MOOC learners from their contributions in the discussion forum

dc.affiliation.dptoUC3M. Departamento de Ingeniería Telemáticaes
dc.affiliation.grupoinvUC3M. Grupo de Investigación: Aplicaciones y Servicios Telemáticos (GAST)es
dc.contributor.authorGarcía Molina, Sergio
dc.contributor.authorAlario-Hoyos, Carlos
dc.contributor.authorMoreno-Marcos, Pedro Manuel
dc.contributor.authorMuñoz Merino, Pedro José
dc.contributor.authorEstévez Ayres, Iria Manuela
dc.contributor.authorDelgado Kloos, Carlos
dc.contributor.funderMinisterio de Ciencia, Innovación y Universidades (España)es
dc.contributor.funderComunidad de Madrides
dc.contributor.funderEuropean Commissionen
dc.description.abstractMOOCs (massive open online courses) have a built-in forum where learners can share experiences as well as ask questions and get answers. Nevertheless, the work of the learners in the MOOC forum is usually not taken into account when calculating their grade in the course, due to the difficulty of automating the calculation of that grade in a context with a very large number of learners. In some situations, discussion forums might even be the only available evidence to grade learners. In other situations, forum interactions could serve as a complement for calculating the grade in addition to traditional summative assessment activities. This paper proposes an algorithm to automatically calculate learners' grades in the MOOC forum, considering both the quantitative dimension and the relevance in their contributions. In addition, the algorithm has been implemented within a web application, providing instructors with a visual and a numerical representation of the grade for each learner. An exploratory analysis is carried out to assess the algorithm and the tool with a MOOC on programming, obtaining a moderate positive correlation between the forum grades provided by the algorithm and the grades obtained through the summative assessment activities. Nevertheless, the complementary analysis conducted indicates that this correlation may not be enough to use the forum grades as predictors of the grades obtained through summative assessment activities.en
dc.description.sponsorshipThis work was supported in part by the FEDER/Ministerio de Ciencia, Innovación y Universidades;Agencia Estatal de Investigación, through the Smartlet Project under Grant TIN2017-85179-C3-1-R, and in part by the Madrid Regional Government through the e-Madrid-CM Project under Grant S2018/TCS-4307, a project which is co-funded by the European Structural Funds (FSE and FEDER). Partial support has also been received from the European Commission through Erasmus+ Capacity Building in the Field of Higher Education projects, more specifically through projects LALA (586120-EPP-1-2017-1-ES-EPPKA2-CBHE-JP), InnovaT (598758-EPP-1-2018-1-AT-EPPKA2-CBHE-JP), and PROF-XXI (609767-EPP-1-2019-1-ES-EPPKA2-CBHE-JP).en
dc.identifier.bibliographicCitationGarcía-Molina, S., Alario-Hoyos, C., Moreno-Marcos, P. M., Muñoz-Merino, P. J., Estévez-Ayres, I., & Delgado Kloos, C. (2020). An Algorithm and a Tool for the Automatic Grading of MOOC Learners from Their Contributions in the Discussion Forum. Applied Sciences, 11(1), 95.en
dc.identifier.publicationtitleApplied Sciencesen
dc.relation.projectIDGobierno de España. TIN2017-85179-C3-1-Res
dc.relation.projectIDComunidad de Madrid. S2018/TCS-4307es
dc.rights© 2020 by the authors.en
dc.rightsAtribución 3.0 España*
dc.rights.accessRightsopen access
dc.subject.otherDiscussion forumen
dc.subject.otherSocial learning analyticsen
dc.subject.otherAutomatic gradingen
dc.titleAn algorithm and a tool for the automatic grading of MOOC learners from their contributions in the discussion forumen
dc.typeresearch article*
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
22.87 MB
Adobe Portable Document Format