How Do Gestural Interactions Support Visuospatial Cognition in STEM Learning?
Saved in:
| Title: | How Do Gestural Interactions Support Visuospatial Cognition in STEM Learning? |
|---|---|
| Language: | English |
| Authors: | Zhen Xu (ORCID |
| Source: | British Journal of Educational Technology. 2026 57(4):1140-1162. |
| Availability: | Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us |
| Peer Reviewed: | Y |
| Page Count: | 23 |
| Publication Date: | 2026 |
| Sponsoring Agency: | National Science Foundation (NSF) |
| Contract Number: | 1849768 2329408 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Nonverbal Communication, Interaction, Visual Perception, Spatial Ability, Cognitive Processes, STEM Education, Performance, Accuracy, Reaction Time, Efficiency, Learning Activities, Individual Differences, Short Term Memory, Inhibition, Task Analysis |
| DOI: | 10.1111/bjet.70053 |
| ISSN: | 0007-1013 1467-8535 |
| Abstract: | Existing literature shows that touchscreen devices can support learning of visuospatially rich STEM content. However, the mechanisms by which touchscreen devices support cognition in learning remains unclear. This study examined how gestural interactions afforded by touchscreen devices support visuospatial cognition in STEM learning by comparing touch-based gestural input with mouse input. This quasi-experimental study was conducted during the implementation of an elementary cryptology and cybersecurity curriculum in afterschool settings. Data included measures of student performance including accuracy, response time and interaction efficiency across two visuospatial learning activities. Students' cognitive individual differences including verbal and visuospatial working memory, visual processing speed and cognitive inhibitory control were measured. A learning test was administered as a pretest and a posttest. Results show that in the simpler learning task, students using touch-based gestural input demonstrated higher interaction efficiency, longer response times and more errors. In the more challenging task, differences between the experimental and comparison groups were not significant. Working memory capacity moderated the accuracy of students' learning performance, with the influence of visuospatial and verbal working memory capacity varying based on the type of representation used in each activity. Fitts' throughput mediated the association between input type and learning outcomes of the curriculum. This study advances our understanding of the cognitive mechanisms underlying the use of touchscreen devices in STEM learning by demonstrating that efficient gestural interaction supports visuospatial cognition and learning. |
| Abstractor: | As Provided |
| Entry Date: | 2026 |
| Accession Number: | EJ1508524 |
| Database: | ERIC |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1508524 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: How Do Gestural Interactions Support Visuospatial Cognition in STEM Learning? – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Zhen+Xu%22">Zhen Xu</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-5080-7684">0000-0002-5080-7684</externalLink>)<br /><searchLink fieldCode="AR" term="%22Pasha+Antonenko%22">Pasha Antonenko</searchLink><br /><searchLink fieldCode="AR" term="%22Kara+M%2E+Dawson%22">Kara M. Dawson</searchLink><br /><searchLink fieldCode="AR" term="%22Do+Hyong+Koh%22">Do Hyong Koh</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-6101-4794">0000-0002-6101-4794</externalLink>)<br /><searchLink fieldCode="AR" term="%22Christine+Wusylko%22">Christine Wusylko</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-3449-9391">0000-0003-3449-9391</externalLink>) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22British+Journal+of+Educational+Technology%22"><i>British Journal of Educational Technology</i></searchLink>. 2026 57(4):1140-1162. – Name: Avail Label: Availability Group: Avail Data: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 23 – Name: DatePubCY Label: Publication Date Group: Date Data: 2026 – Name: SourceSuprt Label: Sponsoring Agency Group: SrcSuprt Data: National Science Foundation (NSF) – Name: NumberContract Label: Contract Number Group: NumCntrct Data: 1849768<br />2329408 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Research – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Nonverbal+Communication%22">Nonverbal Communication</searchLink><br /><searchLink fieldCode="DE" term="%22Interaction%22">Interaction</searchLink><br /><searchLink fieldCode="DE" term="%22Visual+Perception%22">Visual Perception</searchLink><br /><searchLink fieldCode="DE" term="%22Spatial+Ability%22">Spatial Ability</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+Processes%22">Cognitive Processes</searchLink><br /><searchLink fieldCode="DE" term="%22STEM+Education%22">STEM Education</searchLink><br /><searchLink fieldCode="DE" term="%22Performance%22">Performance</searchLink><br /><searchLink fieldCode="DE" term="%22Accuracy%22">Accuracy</searchLink><br /><searchLink fieldCode="DE" term="%22Reaction+Time%22">Reaction Time</searchLink><br /><searchLink fieldCode="DE" term="%22Efficiency%22">Efficiency</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Activities%22">Learning Activities</searchLink><br /><searchLink fieldCode="DE" term="%22Individual+Differences%22">Individual Differences</searchLink><br /><searchLink fieldCode="DE" term="%22Short+Term+Memory%22">Short Term Memory</searchLink><br /><searchLink fieldCode="DE" term="%22Inhibition%22">Inhibition</searchLink><br /><searchLink fieldCode="DE" term="%22Task+Analysis%22">Task Analysis</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1111/bjet.70053 – Name: ISSN Label: ISSN Group: ISSN Data: 0007-1013<br />1467-8535 – Name: Abstract Label: Abstract Group: Ab Data: Existing literature shows that touchscreen devices can support learning of visuospatially rich STEM content. However, the mechanisms by which touchscreen devices support cognition in learning remains unclear. This study examined how gestural interactions afforded by touchscreen devices support visuospatial cognition in STEM learning by comparing touch-based gestural input with mouse input. This quasi-experimental study was conducted during the implementation of an elementary cryptology and cybersecurity curriculum in afterschool settings. Data included measures of student performance including accuracy, response time and interaction efficiency across two visuospatial learning activities. Students' cognitive individual differences including verbal and visuospatial working memory, visual processing speed and cognitive inhibitory control were measured. A learning test was administered as a pretest and a posttest. Results show that in the simpler learning task, students using touch-based gestural input demonstrated higher interaction efficiency, longer response times and more errors. In the more challenging task, differences between the experimental and comparison groups were not significant. Working memory capacity moderated the accuracy of students' learning performance, with the influence of visuospatial and verbal working memory capacity varying based on the type of representation used in each activity. Fitts' throughput mediated the association between input type and learning outcomes of the curriculum. This study advances our understanding of the cognitive mechanisms underlying the use of touchscreen devices in STEM learning by demonstrating that efficient gestural interaction supports visuospatial cognition and learning. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2026 – Name: AN Label: Accession Number Group: ID Data: EJ1508524 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1508524 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1111/bjet.70053 Languages: – Text: English PhysicalDescription: Pagination: PageCount: 23 StartPage: 1140 Subjects: – SubjectFull: Nonverbal Communication Type: general – SubjectFull: Interaction Type: general – SubjectFull: Visual Perception Type: general – SubjectFull: Spatial Ability Type: general – SubjectFull: Cognitive Processes Type: general – SubjectFull: STEM Education Type: general – SubjectFull: Performance Type: general – SubjectFull: Accuracy Type: general – SubjectFull: Reaction Time Type: general – SubjectFull: Efficiency Type: general – SubjectFull: Learning Activities Type: general – SubjectFull: Individual Differences Type: general – SubjectFull: Short Term Memory Type: general – SubjectFull: Inhibition Type: general – SubjectFull: Task Analysis Type: general Titles: – TitleFull: How Do Gestural Interactions Support Visuospatial Cognition in STEM Learning? Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Zhen Xu – PersonEntity: Name: NameFull: Pasha Antonenko – PersonEntity: Name: NameFull: Kara M. Dawson – PersonEntity: Name: NameFull: Do Hyong Koh – PersonEntity: Name: NameFull: Christine Wusylko IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 07 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 0007-1013 – Type: issn-electronic Value: 1467-8535 Numbering: – Type: volume Value: 57 – Type: issue Value: 4 Titles: – TitleFull: British Journal of Educational Technology Type: main |
| ResultId | 1 |