Exploring Shared Monitoring in Large Language Model (LLM)-Supported Online Collaborative Problem Solving for High-Cohesion and Low-Cohesion Groups
Saved in:
| Title: | Exploring Shared Monitoring in Large Language Model (LLM)-Supported Online Collaborative Problem Solving for High-Cohesion and Low-Cohesion Groups |
|---|---|
| Language: | English |
| Authors: | Xiaoyun Liu (ORCID |
| Source: | Journal of Computer Assisted Learning. 2026 42(3). |
| Availability: | Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us |
| Peer Reviewed: | Y |
| Page Count: | 21 |
| Publication Date: | 2026 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Artificial Intelligence, Intervention, Technology Uses in Education, Cooperative Learning, Problem Solving, College Students, Group Unity, Foreign Countries, Scaffolding (Teaching Technique), Student Behavior |
| Geographic Terms: | China |
| DOI: | 10.1002/jcal.70249 |
| ISSN: | 0266-4909 1365-2729 |
| Abstract: | Background: Recent research increasingly highlights the central role of interventions in enhancing shared monitoring during collaborative problem-solving. However, traditional intervention approaches suffer from limitations in timeliness and adaptability. Large language model (LLM), equipped with deep semantic parsing and contextual perception, can dynamically detect latent challenges and provide targeted, timely, context-sensitive feedback. Objectives: This study examines how LLM-supported interventions affect group shared monitoring during dynamic CPS processes. Methods: This study designed a collaborative problem-solving platform integrated with LLM, and 28 students from a university in China participated in CPS activities. Chi-square tests, conditional random fields, linear mixed models and correlation analyses were adopted to examine the changes in both monitoring behaviour and equality of monitoring participation in high-cohesion (HCGs) and low-cohesion groups (LCGs) after LLM-supported group metacognitive scaffolding (LLM-GMS) intervention, as well as their effects on collaborative performance. Results and Conclusions: The results show that (1) LLM-GMS activated more socio-cognitive and behavioural monitoring in HCGs, whereas LCGs mainly exhibited heightened behavioural monitoring. (2) Descriptive analyses revealed divergent trends in monitoring participation equality across group types, with HCGs showing increased equality and LCGs exhibiting a decline. (3) In HCGs, socio-emotional monitoring was positively associated with collaborative performance, whereas participation equality and behavioural monitoring exhibited negative associations with collaborative performance. In contrast, among LCGs, behavioural monitoring was positively related to performance, whereas socio-cognitive monitoring was unexpectedly negatively associated with performance. Implications: These findings highlight that LLM-GMS can be a valuable tool for supporting collaborative learning, but its effectiveness depends on group characteristics and its implementation approach. |
| Abstractor: | As Provided |
| Entry Date: | 2026 |
| Accession Number: | EJ1506852 |
| Database: | ERIC |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1506852 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Exploring Shared Monitoring in Large Language Model (LLM)-Supported Online Collaborative Problem Solving for High-Cohesion and Low-Cohesion Groups – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Xiaoyun+Liu%22">Xiaoyun Liu</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0003-9381-6534">0009-0003-9381-6534</externalLink>)<br /><searchLink fieldCode="AR" term="%22Xu+Du%22">Xu Du</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-9069-6109">0000-0001-9069-6109</externalLink>)<br /><searchLink fieldCode="AR" term="%22Jui-Long+Hung%22">Jui-Long Hung</searchLink><br /><searchLink fieldCode="AR" term="%22Hao+Li%22">Hao Li</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-5230-1348">0000-0001-5230-1348</externalLink>)<br /><searchLink fieldCode="AR" term="%22Shuoqiu+Yang%22">Shuoqiu Yang</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-3297-1026">0000-0002-3297-1026</externalLink>)<br /><searchLink fieldCode="AR" term="%22Yiqian+Xie%22">Yiqian Xie</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0008-9350-1168">0009-0008-9350-1168</externalLink>) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Journal+of+Computer+Assisted+Learning%22"><i>Journal of Computer Assisted Learning</i></searchLink>. 2026 42(3). – Name: Avail Label: Availability Group: Avail Data: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 21 – Name: DatePubCY Label: Publication Date Group: Date Data: 2026 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Research – Name: Audience Label: Education Level Group: Audnce Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink> – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Intervention%22">Intervention</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Cooperative+Learning%22">Cooperative Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Problem+Solving%22">Problem Solving</searchLink><br /><searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink><br /><searchLink fieldCode="DE" term="%22Group+Unity%22">Group Unity</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Scaffolding+%28Teaching+Technique%29%22">Scaffolding (Teaching Technique)</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Behavior%22">Student Behavior</searchLink> – Name: Subject Label: Geographic Terms Group: Su Data: <searchLink fieldCode="DE" term="%22China%22">China</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1002/jcal.70249 – Name: ISSN Label: ISSN Group: ISSN Data: 0266-4909<br />1365-2729 – Name: Abstract Label: Abstract Group: Ab Data: Background: Recent research increasingly highlights the central role of interventions in enhancing shared monitoring during collaborative problem-solving. However, traditional intervention approaches suffer from limitations in timeliness and adaptability. Large language model (LLM), equipped with deep semantic parsing and contextual perception, can dynamically detect latent challenges and provide targeted, timely, context-sensitive feedback. Objectives: This study examines how LLM-supported interventions affect group shared monitoring during dynamic CPS processes. Methods: This study designed a collaborative problem-solving platform integrated with LLM, and 28 students from a university in China participated in CPS activities. Chi-square tests, conditional random fields, linear mixed models and correlation analyses were adopted to examine the changes in both monitoring behaviour and equality of monitoring participation in high-cohesion (HCGs) and low-cohesion groups (LCGs) after LLM-supported group metacognitive scaffolding (LLM-GMS) intervention, as well as their effects on collaborative performance. Results and Conclusions: The results show that (1) LLM-GMS activated more socio-cognitive and behavioural monitoring in HCGs, whereas LCGs mainly exhibited heightened behavioural monitoring. (2) Descriptive analyses revealed divergent trends in monitoring participation equality across group types, with HCGs showing increased equality and LCGs exhibiting a decline. (3) In HCGs, socio-emotional monitoring was positively associated with collaborative performance, whereas participation equality and behavioural monitoring exhibited negative associations with collaborative performance. In contrast, among LCGs, behavioural monitoring was positively related to performance, whereas socio-cognitive monitoring was unexpectedly negatively associated with performance. Implications: These findings highlight that LLM-GMS can be a valuable tool for supporting collaborative learning, but its effectiveness depends on group characteristics and its implementation approach. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2026 – Name: AN Label: Accession Number Group: ID Data: EJ1506852 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1506852 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1002/jcal.70249 Languages: – Text: English PhysicalDescription: Pagination: PageCount: 21 Subjects: – SubjectFull: Artificial Intelligence Type: general – SubjectFull: Intervention Type: general – SubjectFull: Technology Uses in Education Type: general – SubjectFull: Cooperative Learning Type: general – SubjectFull: Problem Solving Type: general – SubjectFull: College Students Type: general – SubjectFull: Group Unity Type: general – SubjectFull: Foreign Countries Type: general – SubjectFull: Scaffolding (Teaching Technique) Type: general – SubjectFull: Student Behavior Type: general – SubjectFull: China Type: general Titles: – TitleFull: Exploring Shared Monitoring in Large Language Model (LLM)-Supported Online Collaborative Problem Solving for High-Cohesion and Low-Cohesion Groups Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Xiaoyun Liu – PersonEntity: Name: NameFull: Xu Du – PersonEntity: Name: NameFull: Jui-Long Hung – PersonEntity: Name: NameFull: Hao Li – PersonEntity: Name: NameFull: Shuoqiu Yang – PersonEntity: Name: NameFull: Yiqian Xie IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 06 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 0266-4909 – Type: issn-electronic Value: 1365-2729 Numbering: – Type: volume Value: 42 – Type: issue Value: 3 Titles: – TitleFull: Journal of Computer Assisted Learning Type: main |
| ResultId | 1 |