View in EDS HTML Full Text PDF Full Text

Accuracy in identifying students' miscues during oral reading: a taxonomy of scorers' mismarkings.

Saved in:
Bibliographic Details
Title: Accuracy in identifying students' miscues during oral reading: a taxonomy of scorers' mismarkings.
Authors: Reed, Deborah K.1, Cummings, Kelli D.2, Schaper, Andrew3, Lynn, Devon4, Biancarosa, Gina5
Source: Reading & Writing. Apr2019, Vol. 32 Issue 4, p1009-1035. 27p.
Subject Terms: *Informal reading inventories, *Curriculum alignment, *Miscue analysis, Tallies, Error
Abstract: Informal reading inventories (IRI) and curriculum-based measures of reading (CBM-R) have continued importance in instructional planning, but raters have exhibited difficulty in accurately identifying students' miscues. To identify and tabulate scorers' mismarkings, this study employed examiners and raters who scored 15,051 words from 108 passage readings by students in Grades 5 and 6. Word-by-word scoring from these individuals was compared with a consensus score obtained from the first author and two graduate students after repeated replaying of the audio from the passage readings. Microanalysis conducted on all discrepancies identified a cumulative total of 929 mismarkings (range = 1–37 per passage) that we categorized in 37 unique types. Examiners scoring live made significantly more mismarkings than raters scoring audio recordings, t(214) = 4.35, p =.0001, with an effect size of d = 0.59. In 98% of the passages, scorers disagreed on the number of words read correctly—the score used for screening and progress monitoring decisions. Results suggest that IRIs and CBM-Rs may not be accurate as diagnostic tools for determining students' particular word-level difficulties. [ABSTRACT FROM AUTHOR]
Copyright of Reading & Writing is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: ehh
DbLabel: Education Research Complete
An: 135661893
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Accuracy in identifying students' miscues during oral reading: a taxonomy of scorers' mismarkings.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Reed%2C+Deborah+K%2E%22">Reed, Deborah K.</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Cummings%2C+Kelli+D%2E%22">Cummings, Kelli D.</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Schaper%2C+Andrew%22">Schaper, Andrew</searchLink><relatesTo>3</relatesTo><br /><searchLink fieldCode="AR" term="%22Lynn%2C+Devon%22">Lynn, Devon</searchLink><relatesTo>4</relatesTo><br /><searchLink fieldCode="AR" term="%22Biancarosa%2C+Gina%22">Biancarosa, Gina</searchLink><relatesTo>5</relatesTo>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Reading+%26+Writing%22">Reading & Writing</searchLink>. Apr2019, Vol. 32 Issue 4, p1009-1035. 27p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Informal+reading+inventories%22">Informal reading inventories</searchLink><br />*<searchLink fieldCode="DE" term="%22Curriculum+alignment%22">Curriculum alignment</searchLink><br />*<searchLink fieldCode="DE" term="%22Miscue+analysis%22">Miscue analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Tallies%22">Tallies</searchLink><br /><searchLink fieldCode="DE" term="%22Error%22">Error</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Informal reading inventories (IRI) and curriculum-based measures of reading (CBM-R) have continued importance in instructional planning, but raters have exhibited difficulty in accurately identifying students' miscues. To identify and tabulate scorers' mismarkings, this study employed examiners and raters who scored 15,051 words from 108 passage readings by students in Grades 5 and 6. Word-by-word scoring from these individuals was compared with a consensus score obtained from the first author and two graduate students after repeated replaying of the audio from the passage readings. Microanalysis conducted on all discrepancies identified a cumulative total of 929 mismarkings (range = 1–37 per passage) that we categorized in 37 unique types. Examiners scoring live made significantly more mismarkings than raters scoring audio recordings, t(214) = 4.35, p =.0001, with an effect size of d = 0.59. In 98% of the passages, scorers disagreed on the number of words read correctly—the score used for screening and progress monitoring decisions. Results suggest that IRIs and CBM-Rs may not be accurate as diagnostic tools for determining students' particular word-level difficulties. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Reading & Writing is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=135661893
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s11145-018-9899-5
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 27
        StartPage: 1009
    Subjects:
      – SubjectFull: Informal reading inventories
        Type: general
      – SubjectFull: Curriculum alignment
        Type: general
      – SubjectFull: Miscue analysis
        Type: general
      – SubjectFull: Tallies
        Type: general
      – SubjectFull: Error
        Type: general
    Titles:
      – TitleFull: Accuracy in identifying students' miscues during oral reading: a taxonomy of scorers' mismarkings.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Reed, Deborah K.
      – PersonEntity:
          Name:
            NameFull: Cummings, Kelli D.
      – PersonEntity:
          Name:
            NameFull: Schaper, Andrew
      – PersonEntity:
          Name:
            NameFull: Lynn, Devon
      – PersonEntity:
          Name:
            NameFull: Biancarosa, Gina
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 04
              Text: Apr2019
              Type: published
              Y: 2019
          Identifiers:
            – Type: issn-print
              Value: 09224777
          Numbering:
            – Type: volume
              Value: 32
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: Reading & Writing
              Type: main
ResultId 1