The validity and utility of activity logs as a measure of student engagement

Motz, Benjamin and Quick, Joshua and Schroeder, Noah and Zook, Jordon and Gunkel, Matthew (2019) The validity and utility of activity logs as a measure of student engagement. In: Proceedings of the 9th International Conference on Learning Analytics & Knowledge - LAK19.

Full text not available from this repository.
Official URL: http://dl.acm.org/citation.cfm?doid=3303772.330378...

Abstract

Learning management system (LMS) web logs provide granular, near-real-time records of student behavior as learners interact with online course materials in digital learning environments. However, it remains unclear whether LMS activity indeed reflects behavioral properties of student engagement, and it also remains unclear how to deal with variability in LMS usage across a diversity of courses. In this study, we evaluate whether instructors' subjective ratings of their students' engagement are related to features of LMS activity for 9,021 students enrolled in 473 for-credit courses. We find that estimators derived from LMS web logs are closely related to instructor ratings of engagement, however, we also observe that there is not a single generic relationship between activity and engagement, and what constitutes the behavioral components of "engagement" will be contingent on course structure. However, for many of these courses, modeled engagement scores are comparable to instructors' ratings in their sensitivity for predicting academic performance. As long as they are tuned to the differences between courses, activity indices from LMS web logs can provide a valid and useful proxy measure of student engagement.

Item Type: Conference or Workshop Item (UNSPECIFIED)
Depositing User: Repo Admin
Date Deposited: 03 Mar 2019 15:59
Last Modified: 03 Mar 2019 15:59
URI: http://lib.e-learning.ph/id/eprint/99

Actions (login required)

View Item View Item