Using Learner Trace Data to Understand Metacognitive Processes in Writing from Multiple Sources

Mladen Rakovic, Yizhou Fan, Joep van der Graaf, Shaveen Singh, Jonathan Kilgour, Lyn Lim, Johanna Moore, Maria Bannert, Inge Molenaar, Dragan Gasevic

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

Writing from multiple sources is a commonly administered learning task across educational levels and disciplines. In this task, learners are instructed to comprehend information from source documents and integrate it into a coherent written composition to fulfil the assignment requirements. Even though educationally potent, multi-source writing tasks are considered challenging to many learners, in particular because many learners underuse monitoring and control, critical metacognitive processes for productive engagement in multi-source writing. To understand these processes, we conducted a laboratory study involving 44 university students. They engaged in multi-source writing task hosted in digital learning environment. Adding to previous research, we unobtrusively measured metacognitive processes using learners’ trace data collected via multiple data channels and in both writing and reading space of the multi-source writing task. We further investigated how these processes affect the quality of a written product, i.e., essay score. In the analysis, we utilised both automatically and human-generated essay score. The rating performance of the essay scoring algorithm was comparable to that of human raters. Our results largely support the theoretical assumptions that engagement in metacognitive monitoring and control benefits the quality of written product. Moreover, our results can inform the development of analytics-based tools that support student writing by making use of trace data and automated essay scoring.
Original languageEnglish
Title of host publicationLAK22: 12th International Learning Analytics and Knowledge Conference
Place of PublicationNew York, NY, USA
PublisherAssociation for Computing Machinery, Inc
Number of pages12
ISBN (Print)9781450395731
Publication statusPublished - 21 Mar 2022
EventThe 12th International Learning Analytics and Knowledge Conference - Online
Duration: 21 Mar 202225 Mar 2022
Conference number: 12

Publication series

PublisherAssociation for Computing Machinery


ConferenceThe 12th International Learning Analytics and Knowledge Conference
Abbreviated titleLAK 22
Internet address

Keywords / Materials (for Non-textual outputs)

  • writing from multiple sources
  • monitoring
  • semantic similarity
  • reading


Dive into the research topics of 'Using Learner Trace Data to Understand Metacognitive Processes in Writing from Multiple Sources'. Together they form a unique fingerprint.

Cite this