Examining the (In)Accuracies and Challenges When Rating Students' L2 Listening Notes
Saved in:
| Title: | Examining the (In)Accuracies and Challenges When Rating Students' L2 Listening Notes |
|---|---|
| Language: | English |
| Authors: | Naheen Madarbakus-Ring (ORCID |
| Source: | Language Learning in Higher Education. 2025 15(2):401-429. |
| Availability: | De Gruyter Mouton. Available from: Walter de Gruyter, Inc. 121 High Street, Third Floor, Boston, MA 02110. Tel: 857-284-7073; Fax: 857-284-7358; e-mail: service@degruyter.com; Web site: http://www.degruyter.com |
| Peer Reviewed: | Y |
| Page Count: | 29 |
| Publication Date: | 2025 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Teacher Researchers, Information Utilization, Scoring Rubrics, Listening, Notetaking, Second Language Learning, Grading, Decision Making, Foreign Countries |
| Geographic Terms: | Japan, Sweden |
| DOI: | 10.1515/cercles-2024-0076 |
| ISSN: | 2191-611X 2191-6128 |
| Abstract: | Information units (IUs) have been proposed as a way of grading students' notes. However, little work has been done to validate and check the reliability of such an approach. This study explores how teacher-researchers (TRs) use information units (IUs) to rate content items in students' listening notes using a rubric. Data were collected from six TRs who graded four students' listening notes. Each TR identified and rated the IUs in the students' notes using a 4-point rubric scoring system before commenting on the notes they had graded. The main aim of this study was to examine if each TR awarded similar IU ratings between the items they graded. The results showed there were inconsistencies between the TRs ratings of the students' notes. However, each TR consistently interpreted the IUs in the same way internally across multiple texts. These findings indicate that further training in using IUs is needed to add validity and reliability to the potential rating system for grading students' listening notes. |
| Abstractor: | As Provided |
| Entry Date: | 2025 |
| Accession Number: | EJ1491024 |
| Database: | ERIC |
| Abstract: | Information units (IUs) have been proposed as a way of grading students' notes. However, little work has been done to validate and check the reliability of such an approach. This study explores how teacher-researchers (TRs) use information units (IUs) to rate content items in students' listening notes using a rubric. Data were collected from six TRs who graded four students' listening notes. Each TR identified and rated the IUs in the students' notes using a 4-point rubric scoring system before commenting on the notes they had graded. The main aim of this study was to examine if each TR awarded similar IU ratings between the items they graded. The results showed there were inconsistencies between the TRs ratings of the students' notes. However, each TR consistently interpreted the IUs in the same way internally across multiple texts. These findings indicate that further training in using IUs is needed to add validity and reliability to the potential rating system for grading students' listening notes. |
|---|---|
| ISSN: | 2191-611X 2191-6128 |
| DOI: | 10.1515/cercles-2024-0076 |
