Computational Sentence‐Level Metrics of Reading Speed and Its Ramifications for Sentence Comprehension.

Saved in:
Bibliographic Details
Title: Computational Sentence‐Level Metrics of Reading Speed and Its Ramifications for Sentence Comprehension.
Authors: Sun, Kun1,2 (AUTHOR) kunsun@tongji.edu.cn, Wang, Rong2,3 (AUTHOR) rong.wang@uni-tuebingen.de
Source: Cognitive Science. Jul2025, Vol. 49 Issue 7, p1-25. 25p.
Subject Terms: *Reading speed, *Reading comprehension, *Cognitive science, Text processing (Computer science), Linguistic complexity, Language models, Psycholinguistics
Abstract: The majority of research in computational psycholinguistics on sentence processing has focused on word‐by‐word incremental processing within sentences, rather than holistic sentence‐level representations. This study introduces two novel computational approaches for quantifying sentence‐level processing: sentence surprisal and sentence relevance. Using multilingual large language models (LLMs), we compute sentence surprisal through three methods, chain rule, next sentence prediction, and negative log‐likelihood, and apply a "memory‐aware" approach to calculate sentence‐level semantic relevance based on convolution operations. The sentence‐level metrics developed are tested and compared to validate whether they can predict the reading speed of sentences, and, further, we explore how sentence‐level metrics take effects on human processing and comprehending sentences as a whole across languages. The results show that sentence‐level metrics are highly capable of predicting sentence reading speed. Our results also indicate that these computational sentence‐level metrics are exceptionally effective at predicting and explaining the processing difficulties encountered by readers in processing sentences as a whole across a variety of languages. The proposed sentence‐level metrics offer significant interpretability and achieve high accuracy in predicting human sentence reading speed, as they capture unique aspects of comprehension difficulty beyond word‐level measures. These metrics serve as valuable computational tools for investigating human sentence processing and advancing our understanding of naturalistic reading. Their strong performance and generalization capabilities highlight their potential to drive progress at the intersection of LLMs and cognitive science. [ABSTRACT FROM AUTHOR]
Copyright of Cognitive Science is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: ehh
DbLabel: Education Research Complete
An: 186884178
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Computational Sentence‐Level Metrics of Reading Speed and Its Ramifications for Sentence Comprehension.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Sun%2C+Kun%22">Sun, Kun</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> kunsun@tongji.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Wang%2C+Rong%22">Wang, Rong</searchLink><relatesTo>2,3</relatesTo> (AUTHOR)<i> rong.wang@uni-tuebingen.de</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Cognitive+Science%22">Cognitive Science</searchLink>. Jul2025, Vol. 49 Issue 7, p1-25. 25p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Reading+speed%22">Reading speed</searchLink><br />*<searchLink fieldCode="DE" term="%22Reading+comprehension%22">Reading comprehension</searchLink><br />*<searchLink fieldCode="DE" term="%22Cognitive+science%22">Cognitive science</searchLink><br /><searchLink fieldCode="DE" term="%22Text+processing+%28Computer+science%29%22">Text processing (Computer science)</searchLink><br /><searchLink fieldCode="DE" term="%22Linguistic+complexity%22">Linguistic complexity</searchLink><br /><searchLink fieldCode="DE" term="%22Language+models%22">Language models</searchLink><br /><searchLink fieldCode="DE" term="%22Psycholinguistics%22">Psycholinguistics</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The majority of research in computational psycholinguistics on sentence processing has focused on word‐by‐word incremental processing within sentences, rather than holistic sentence‐level representations. This study introduces two novel computational approaches for quantifying sentence‐level processing: sentence surprisal and sentence relevance. Using multilingual large language models (LLMs), we compute sentence surprisal through three methods, chain rule, next sentence prediction, and negative log‐likelihood, and apply a "memory‐aware" approach to calculate sentence‐level semantic relevance based on convolution operations. The sentence‐level metrics developed are tested and compared to validate whether they can predict the reading speed of sentences, and, further, we explore how sentence‐level metrics take effects on human processing and comprehending sentences as a whole across languages. The results show that sentence‐level metrics are highly capable of predicting sentence reading speed. Our results also indicate that these computational sentence‐level metrics are exceptionally effective at predicting and explaining the processing difficulties encountered by readers in processing sentences as a whole across a variety of languages. The proposed sentence‐level metrics offer significant interpretability and achieve high accuracy in predicting human sentence reading speed, as they capture unique aspects of comprehension difficulty beyond word‐level measures. These metrics serve as valuable computational tools for investigating human sentence processing and advancing our understanding of naturalistic reading. Their strong performance and generalization capabilities highlight their potential to drive progress at the intersection of LLMs and cognitive science. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Cognitive Science is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=186884178
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1111/cogs.70092
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 25
        StartPage: 1
    Subjects:
      – SubjectFull: Reading speed
        Type: general
      – SubjectFull: Reading comprehension
        Type: general
      – SubjectFull: Cognitive science
        Type: general
      – SubjectFull: Text processing (Computer science)
        Type: general
      – SubjectFull: Linguistic complexity
        Type: general
      – SubjectFull: Language models
        Type: general
      – SubjectFull: Psycholinguistics
        Type: general
    Titles:
      – TitleFull: Computational Sentence‐Level Metrics of Reading Speed and Its Ramifications for Sentence Comprehension.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Sun, Kun
      – PersonEntity:
          Name:
            NameFull: Wang, Rong
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 07
              Text: Jul2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 03640213
          Numbering:
            – Type: volume
              Value: 49
            – Type: issue
              Value: 7
          Titles:
            – TitleFull: Cognitive Science
              Type: main
ResultId 1