TY - JOUR
T1 - What Attention Regulation Behaviors Tell Us About Learners in E-Reading?
T2 - Adaptive Data-Driven Persona Development and Application Based on Unsupervised Learning
AU - Lee, Yoon
AU - Migut, Gosia
AU - Specht, Marcus
N1 - Publisher Copyright:
© 2013 IEEE.
PY - 2023
Y1 - 2023
N2 - Different individual features of the learner data often work as essential indicators of learning and intervention needs. This work exploits the personas in the design thinking process as the theoretical basis to analyze and cluster learners' learning behavior patterns as groups. To adapt to the learning practice, we develop data-driven personas by clustering learners' features based on factual learning outcomes (i.e., knowledge gain, perceived learning experience, perceived social presence) based on unsupervised learning, a more accessible and objective intervention design strategy for e-reading practices. Using the Chi-square test, we quantitatively evaluate different clusters driven by various unsupervised learning methods on the multimodal SKEP dataset. Furthermore, for a more practical real-life application, we achieved automatic persona prediction based on the attention regulation behaviors of learners. The subject-independent evaluation results indicate the best classification accuracy of 70% for the four-level classification task, differentiating three personas of learners with needs and another without feedback needs. It also shows that time-based sampling on both independent and cumulative learner behaviors works as robust predictors of learner personas, achieving a stable accuracy range of 65%-70% throughout the e-reading with the SVM classifier. Our work inspires the design of a real-time feedback loop for e-learning based on conversational agents.
AB - Different individual features of the learner data often work as essential indicators of learning and intervention needs. This work exploits the personas in the design thinking process as the theoretical basis to analyze and cluster learners' learning behavior patterns as groups. To adapt to the learning practice, we develop data-driven personas by clustering learners' features based on factual learning outcomes (i.e., knowledge gain, perceived learning experience, perceived social presence) based on unsupervised learning, a more accessible and objective intervention design strategy for e-reading practices. Using the Chi-square test, we quantitatively evaluate different clusters driven by various unsupervised learning methods on the multimodal SKEP dataset. Furthermore, for a more practical real-life application, we achieved automatic persona prediction based on the attention regulation behaviors of learners. The subject-independent evaluation results indicate the best classification accuracy of 70% for the four-level classification task, differentiating three personas of learners with needs and another without feedback needs. It also shows that time-based sampling on both independent and cumulative learner behaviors works as robust predictors of learner personas, achieving a stable accuracy range of 65%-70% throughout the e-reading with the SVM classifier. Our work inspires the design of a real-time feedback loop for e-learning based on conversational agents.
KW - Data-driven persona development
KW - human-robot interaction
KW - instructional design
KW - learning analytics
KW - unsupervised learning
UR - http://www.scopus.com/inward/record.url?scp=85176374093&partnerID=8YFLogxK
U2 - 10.1109/ACCESS.2023.3327334
DO - 10.1109/ACCESS.2023.3327334
M3 - Article
AN - SCOPUS:85176374093
SN - 2169-3536
VL - 11
SP - 118890
EP - 118906
JO - IEEE Access
JF - IEEE Access
ER -