View in EDS

Examining the (In)Accuracies and Challenges When Rating Students' L2 Listening Notes

Saved in:
Bibliographic Details
Title: Examining the (In)Accuracies and Challenges When Rating Students' L2 Listening Notes
Language: English
Authors: Naheen Madarbakus-Ring (ORCID 0000-0003-0857-9515), Michael Crawford, Nathan Thomas Ducker (ORCID 0000-0003-1295-1762)
Source: Language Learning in Higher Education. 2025 15(2):401-429.
Availability: De Gruyter Mouton. Available from: Walter de Gruyter, Inc. 121 High Street, Third Floor, Boston, MA 02110. Tel: 857-284-7073; Fax: 857-284-7358; e-mail: service@degruyter.com; Web site: http://www.degruyter.com
Peer Reviewed: Y
Page Count: 29
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Descriptors: Teacher Researchers, Information Utilization, Scoring Rubrics, Listening, Notetaking, Second Language Learning, Grading, Decision Making, Foreign Countries
Geographic Terms: Japan, Sweden
DOI: 10.1515/cercles-2024-0076
ISSN: 2191-611X
2191-6128
Abstract: Information units (IUs) have been proposed as a way of grading students' notes. However, little work has been done to validate and check the reliability of such an approach. This study explores how teacher-researchers (TRs) use information units (IUs) to rate content items in students' listening notes using a rubric. Data were collected from six TRs who graded four students' listening notes. Each TR identified and rated the IUs in the students' notes using a 4-point rubric scoring system before commenting on the notes they had graded. The main aim of this study was to examine if each TR awarded similar IU ratings between the items they graded. The results showed there were inconsistencies between the TRs ratings of the students' notes. However, each TR consistently interpreted the IUs in the same way internally across multiple texts. These findings indicate that further training in using IUs is needed to add validity and reliability to the potential rating system for grading students' listening notes.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1491024
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1491024
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Examining the (In)Accuracies and Challenges When Rating Students' L2 Listening Notes
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Naheen+Madarbakus-Ring%22">Naheen Madarbakus-Ring</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-0857-9515">0000-0003-0857-9515</externalLink>)<br /><searchLink fieldCode="AR" term="%22Michael+Crawford%22">Michael Crawford</searchLink><br /><searchLink fieldCode="AR" term="%22Nathan+Thomas+Ducker%22">Nathan Thomas Ducker</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-1295-1762">0000-0003-1295-1762</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Language+Learning+in+Higher+Education%22"><i>Language Learning in Higher Education</i></searchLink>. 2025 15(2):401-429.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: De Gruyter Mouton. Available from: Walter de Gruyter, Inc. 121 High Street, Third Floor, Boston, MA 02110. Tel: 857-284-7073; Fax: 857-284-7358; e-mail: service@degruyter.com; Web site: http://www.degruyter.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 29
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Teacher+Researchers%22">Teacher Researchers</searchLink><br /><searchLink fieldCode="DE" term="%22Information+Utilization%22">Information Utilization</searchLink><br /><searchLink fieldCode="DE" term="%22Scoring+Rubrics%22">Scoring Rubrics</searchLink><br /><searchLink fieldCode="DE" term="%22Listening%22">Listening</searchLink><br /><searchLink fieldCode="DE" term="%22Notetaking%22">Notetaking</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Learning%22">Second Language Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Grading%22">Grading</searchLink><br /><searchLink fieldCode="DE" term="%22Decision+Making%22">Decision Making</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Japan%22">Japan</searchLink><br /><searchLink fieldCode="DE" term="%22Sweden%22">Sweden</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1515/cercles-2024-0076
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2191-611X<br />2191-6128
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Information units (IUs) have been proposed as a way of grading students' notes. However, little work has been done to validate and check the reliability of such an approach. This study explores how teacher-researchers (TRs) use information units (IUs) to rate content items in students' listening notes using a rubric. Data were collected from six TRs who graded four students' listening notes. Each TR identified and rated the IUs in the students' notes using a 4-point rubric scoring system before commenting on the notes they had graded. The main aim of this study was to examine if each TR awarded similar IU ratings between the items they graded. The results showed there were inconsistencies between the TRs ratings of the students' notes. However, each TR consistently interpreted the IUs in the same way internally across multiple texts. These findings indicate that further training in using IUs is needed to add validity and reliability to the potential rating system for grading students' listening notes.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1491024
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1491024
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1515/cercles-2024-0076
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 29
        StartPage: 401
    Subjects:
      – SubjectFull: Teacher Researchers
        Type: general
      – SubjectFull: Information Utilization
        Type: general
      – SubjectFull: Scoring Rubrics
        Type: general
      – SubjectFull: Listening
        Type: general
      – SubjectFull: Notetaking
        Type: general
      – SubjectFull: Second Language Learning
        Type: general
      – SubjectFull: Grading
        Type: general
      – SubjectFull: Decision Making
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Japan
        Type: general
      – SubjectFull: Sweden
        Type: general
    Titles:
      – TitleFull: Examining the (In)Accuracies and Challenges When Rating Students' L2 Listening Notes
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Naheen Madarbakus-Ring
      – PersonEntity:
          Name:
            NameFull: Michael Crawford
      – PersonEntity:
          Name:
            NameFull: Nathan Thomas Ducker
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 10
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 2191-611X
            – Type: issn-electronic
              Value: 2191-6128
          Numbering:
            – Type: volume
              Value: 15
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Language Learning in Higher Education
              Type: main
ResultId 1