Development and validation of a rapid and precise online sentence reading efficiency assessment.
Saved in:
| Title: | Development and validation of a rapid and precise online sentence reading efficiency assessment. |
|---|---|
| Authors: | Yeatman, Jason D.1,2,3 (AUTHOR) jyeatman@stanford.edu, Tran, Jasmine E.1,3 (AUTHOR), Burkhardt, Amy K.4 (AUTHOR), Ma, Wanjing Anya1 (AUTHOR), Mitchell, Jamie L.1,2 (AUTHOR), Yablonski, Maya1,3 (AUTHOR), Gijbels, Liesbeth5 (AUTHOR), Townley-Flores, Carrie1 (AUTHOR), Richie-Halford, Adam1,3 (AUTHOR) |
| Source: | Frontiers in Education. 2024, p1-14. 14p. |
| Subject Terms: | *Artificial intelligence, *Silent reading, *Test validity, *Dyslexia, Psychometrics |
| Abstract: | Introduction: The speed at which students can accurately read and understand connected text is at the foundation of reading development. Timed reading measures go under a variety of names (e.g., reading fluency, reading efficiency, etc) and involve different levels of demands on comprehension, making it hard to interpret the extent to which scores reflect differences in reading efficiency versus comprehension. Methods: Here we define a new measure of silent sentence reading efficiency (SRE) and explore key aspects of item development for an unproctored, online SRE assessment (ROAR-SRE). In doing so, we set forth an argument for developing sentences that are simple assertions, with an unambiguous answer, requiring minimal background knowledge and vocabulary. We then run a large-scale validation study to document convergent validity between ROAR-SRE and other measures of reading. Finally we validate the reliability and accuracy of using artificial intelligence (AI) to generate matched test forms. Results: We find that a short, one-minute SRE assessment is highly correlated with other reading measures and has exceptional reliability. Moreover, AI can automatically generate test forms that are matched to manually-authored test forms. Discussion: Together these results highlight the potential for regular screening and progress monitoring at scale with ROAR-SRE. [ABSTRACT FROM AUTHOR] |
| Copyright of Frontiers in Education is the property of Frontiers Media S.A. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 181927086 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Development and validation of a rapid and precise online sentence reading efficiency assessment. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Yeatman%2C+Jason+D%2E%22">Yeatman, Jason D.</searchLink><relatesTo>1,2,3</relatesTo> (AUTHOR)<i> jyeatman@stanford.edu</i><br /><searchLink fieldCode="AR" term="%22Tran%2C+Jasmine+E%2E%22">Tran, Jasmine E.</searchLink><relatesTo>1,3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Burkhardt%2C+Amy+K%2E%22">Burkhardt, Amy K.</searchLink><relatesTo>4</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Ma%2C+Wanjing+Anya%22">Ma, Wanjing Anya</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Mitchell%2C+Jamie+L%2E%22">Mitchell, Jamie L.</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Yablonski%2C+Maya%22">Yablonski, Maya</searchLink><relatesTo>1,3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Gijbels%2C+Liesbeth%22">Gijbels, Liesbeth</searchLink><relatesTo>5</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Townley-Flores%2C+Carrie%22">Townley-Flores, Carrie</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Richie-Halford%2C+Adam%22">Richie-Halford, Adam</searchLink><relatesTo>1,3</relatesTo> (AUTHOR) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Frontiers+in+Education%22">Frontiers in Education</searchLink>. 2024, p1-14. 14p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Artificial+intelligence%22">Artificial intelligence</searchLink><br />*<searchLink fieldCode="DE" term="%22Silent+reading%22">Silent reading</searchLink><br />*<searchLink fieldCode="DE" term="%22Test+validity%22">Test validity</searchLink><br />*<searchLink fieldCode="DE" term="%22Dyslexia%22">Dyslexia</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Introduction: The speed at which students can accurately read and understand connected text is at the foundation of reading development. Timed reading measures go under a variety of names (e.g., reading fluency, reading efficiency, etc) and involve different levels of demands on comprehension, making it hard to interpret the extent to which scores reflect differences in reading efficiency versus comprehension. Methods: Here we define a new measure of silent sentence reading efficiency (SRE) and explore key aspects of item development for an unproctored, online SRE assessment (ROAR-SRE). In doing so, we set forth an argument for developing sentences that are simple assertions, with an unambiguous answer, requiring minimal background knowledge and vocabulary. We then run a large-scale validation study to document convergent validity between ROAR-SRE and other measures of reading. Finally we validate the reliability and accuracy of using artificial intelligence (AI) to generate matched test forms. Results: We find that a short, one-minute SRE assessment is highly correlated with other reading measures and has exceptional reliability. Moreover, AI can automatically generate test forms that are matched to manually-authored test forms. Discussion: Together these results highlight the potential for regular screening and progress monitoring at scale with ROAR-SRE. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Frontiers in Education is the property of Frontiers Media S.A. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=181927086 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.3389/feduc.2024.1494431 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 14 StartPage: 1 Subjects: – SubjectFull: Artificial intelligence Type: general – SubjectFull: Silent reading Type: general – SubjectFull: Test validity Type: general – SubjectFull: Dyslexia Type: general – SubjectFull: Psychometrics Type: general Titles: – TitleFull: Development and validation of a rapid and precise online sentence reading efficiency assessment. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Yeatman, Jason D. – PersonEntity: Name: NameFull: Tran, Jasmine E. – PersonEntity: Name: NameFull: Burkhardt, Amy K. – PersonEntity: Name: NameFull: Ma, Wanjing Anya – PersonEntity: Name: NameFull: Mitchell, Jamie L. – PersonEntity: Name: NameFull: Yablonski, Maya – PersonEntity: Name: NameFull: Gijbels, Liesbeth – PersonEntity: Name: NameFull: Townley-Flores, Carrie – PersonEntity: Name: NameFull: Richie-Halford, Adam IsPartOfRelationships: – BibEntity: Dates: – D: 27 M: 12 Text: 2024 Type: published Y: 2024 Identifiers: – Type: issn-print Value: 2504284X Titles: – TitleFull: Frontiers in Education Type: main |
| ResultId | 1 |