Publication:
Generalizing predictive models of admission test success based on online interactions

Loading...
Thumbnail Image
Identifiers
Publication date
2019-09-10
Defense date
Authors
Moreno-Marcos, Pedro Manuel
Laet, Tinne De
Muñoz Merino, Pedro José
Soom, Carolien Van
Broos, Tom
Verbert, Katrien
Delgado Kloos, Carlos
Advisors
Tutors
Journal Title
Journal ISSN
Volume Title
Publisher
MDPI
Impact
Google Scholar
Export
Research Projects
Organizational Units
Journal Issue
Abstract
To start medical or dentistry studies in Flanders, prospective students need to pass a central admission test. A blended program with four Small Private Online Courses (SPOCs) was designed to support those students. The logs from the platform provide an opportunity to delve into the learners' interactions and to develop predictive models to forecast success in the test. Moreover, the use of different courses allows analyzing how models can generalize across courses. This article has the following objectives: (1) to develop and analyze predictive models to forecast who will pass the admission test, (2) to discover which variables have more effect on success in different courses, (3) to analyze to what extent models can be generalized to other courses and subsequent cohorts, and (4) to discuss the conditions to achieve generalizability. The results show that the average grade in SPOC exercises using only first attempts is the best predictor and that it is possible to transfer predictive models with enough reliability when some context-related conditions are met. The best performance is achieved when transferring within the same cohort to other SPOCs in a similar context. The performance is still acceptable in a consecutive edition of a course. These findings support the sustainability of predictive models.
Description
This article belongs to the Special Issue Sustainability of Learning Analytics
Keywords
Generalizability, Indicators, Learners' Success, Learning Analytics, Prediction, Spocs
Bibliographic citation
Moreno-Marcos PM... [et al.]. Generalizing Predictive Models of Admission Test Success Based on Online Interactions. Sustainability. 2019; 11(18):4940.