RT info:eu-repo/semantics/article
T1 How well do collaboration quality estimation models generalize across authentic school contexts?
A1 Chejara, Pankaj
A1 Kasepalu, Reet
A1 Prieto Santos, Luis Pablo
A1 Rodríguez Triana, María Jesús
A1 Ruiz Calleja, Adolfo
A1 Schneider, Bertrand
K1 collaboration quality
K1 computer-supported collaborative learning
K1 generalizability
K1 machine learning
K1 multimodal learning analytics
AB Multimodal learning analytics (MMLA) research has made significant progress in modelling collaboration quality for the purpose of understanding collaboration behaviour and building automated collaboration estimation models. Deploying these automated models in authentic classroom scenarios, however, remains a challenge. This paper presents findings from an evaluation of collaboration quality estimation models. We collected audio, video and log data from two different Estonian schools. These data were used in different combinations to build collaboration estimation models and then assessed across different subjects, different types of activities (collaborative-writing, group-discussion) and different schools. Our results suggest that the automated collaboration model can generalize to the context of different schools but with a 25% degradation in balanced accuracy (from 82% to 57%). Moreover, the results also indicate that multimodality brings more performance improvement in the case of group-discussion-based activities than collaborative-writing-based activities. Further, our results suggest that the video data could be an alternative for understanding collaboration in authentic settings where higher-quality audio data cannot be collected due to contextual factors. The findings have implications for building automated collaboration estimation systems to assist teachers with monitoring their collaborative classrooms.
PB BERA
SN 0007-1013
YR 2023
FD 2023
LK https://uvadoc.uva.es/handle/10324/83195
UL https://uvadoc.uva.es/handle/10324/83195
LA eng
NO British Journal of Educational Technology, 2023, vol. 55, n 4, pp. 1602-1624
NO Producción Científica
DS UVaDOC
RD 27-feb-2026