Examining the Impact of Sample Length on the Reliability of Narrative Retell Language Samples.
Saved in:
| Title: | Examining the Impact of Sample Length on the Reliability of Narrative Retell Language Samples. |
|---|---|
| Authors: | Hollis, Jenna1, Petersen, Douglas B.2 dpeter39@uwyo.edu |
| Source: | American Journal of Speech-Language Pathology. Jul2025, Vol. 34 Issue 4, p2280-2290. 11p. |
| Subject Terms: | *Comparative grammar, *Speech evaluation, *School children, *Research, *Comparative studies, *Evaluation, Descriptive statistics, Reliability (Personality trait) |
| Geographic Terms: | Arizona, Utah, Colorado |
| Abstract: | Purpose: Clinicians routinely cite a lack of time available to elicit, transcribe, segment, and analyze language samples. Therefore, the purpose of this study was to determine if a shorter narrative language sample maintained acceptable levels of reliability as a more traditional, longer narrative sample. Method: The participants included 190 school-age children in the first to sixth grades. Participants completed two, brief narrative retells using the Narrative Language Measures (NLM) Listening subtest of the CUBED assessment and one longer, narrative retell using the wordless picture book, Frog, Where Are You? (FWAY). These language samples were then analyzed for language productivity, complexity, and story grammar elements using the Systematic Analysis of Language Transcripts software program and the NLM Flow Chart. Results: Our hypothesis was that there would be evidence of relative reliability between the NLM and FWAY, but the correlations would not be as strong as data reported in previous studies that used segments from within the same language sample; this hypothesis was confirmed. Regarding absolute reliability, we hypothesized that the NLM would yield greater language complexity due to the model stories having a greater density of language complexity features. This hypothesis was confirmed. The NLM elicited significantly higher values for sub-ordination index, moving average type-token ratio, and words per minute. Only percent opportunities of narrative structure was significantly higher for FWAY. Mean length of utterance was not statistically different. Conclusions: It appears that shorter narrative retells elicited from a complex model have the possible advantage of taxing a student's language ability, potentially yielding more complex language from a child. Academically relevant information can be gathered from a brief narrative retell elicited from a complex model. Consequently, the CUBED NLM subtest, which can be administered and scored in approximately 2 min, provides a clinically efficient, less cumbersome, and academically relevant language sample for clinicians. [ABSTRACT FROM AUTHOR] |
| Copyright of American Journal of Speech-Language Pathology is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 186535594 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Examining the Impact of Sample Length on the Reliability of Narrative Retell Language Samples. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Hollis%2C+Jenna%22">Hollis, Jenna</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Petersen%2C+Douglas+B%2E%22">Petersen, Douglas B.</searchLink><relatesTo>2</relatesTo><i> dpeter39@uwyo.edu</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22American+Journal+of+Speech-Language+Pathology%22">American Journal of Speech-Language Pathology</searchLink>. Jul2025, Vol. 34 Issue 4, p2280-2290. 11p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Comparative+grammar%22">Comparative grammar</searchLink><br />*<searchLink fieldCode="DE" term="%22Speech+evaluation%22">Speech evaluation</searchLink><br />*<searchLink fieldCode="DE" term="%22School+children%22">School children</searchLink><br />*<searchLink fieldCode="DE" term="%22Research%22">Research</searchLink><br />*<searchLink fieldCode="DE" term="%22Comparative+studies%22">Comparative studies</searchLink><br />*<searchLink fieldCode="DE" term="%22Evaluation%22">Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Descriptive+statistics%22">Descriptive statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Reliability+%28Personality+trait%29%22">Reliability (Personality trait)</searchLink> – Name: SubjectGeographic Label: Geographic Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Arizona%22">Arizona</searchLink><br /><searchLink fieldCode="DE" term="%22Utah%22">Utah</searchLink><br /><searchLink fieldCode="DE" term="%22Colorado%22">Colorado</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Purpose: Clinicians routinely cite a lack of time available to elicit, transcribe, segment, and analyze language samples. Therefore, the purpose of this study was to determine if a shorter narrative language sample maintained acceptable levels of reliability as a more traditional, longer narrative sample. Method: The participants included 190 school-age children in the first to sixth grades. Participants completed two, brief narrative retells using the Narrative Language Measures (NLM) Listening subtest of the CUBED assessment and one longer, narrative retell using the wordless picture book, Frog, Where Are You? (FWAY). These language samples were then analyzed for language productivity, complexity, and story grammar elements using the Systematic Analysis of Language Transcripts software program and the NLM Flow Chart. Results: Our hypothesis was that there would be evidence of relative reliability between the NLM and FWAY, but the correlations would not be as strong as data reported in previous studies that used segments from within the same language sample; this hypothesis was confirmed. Regarding absolute reliability, we hypothesized that the NLM would yield greater language complexity due to the model stories having a greater density of language complexity features. This hypothesis was confirmed. The NLM elicited significantly higher values for sub-ordination index, moving average type-token ratio, and words per minute. Only percent opportunities of narrative structure was significantly higher for FWAY. Mean length of utterance was not statistically different. Conclusions: It appears that shorter narrative retells elicited from a complex model have the possible advantage of taxing a student's language ability, potentially yielding more complex language from a child. Academically relevant information can be gathered from a brief narrative retell elicited from a complex model. Consequently, the CUBED NLM subtest, which can be administered and scored in approximately 2 min, provides a clinically efficient, less cumbersome, and academically relevant language sample for clinicians. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of American Journal of Speech-Language Pathology is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=186535594 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1044/2025_AJSLP-23-00428 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 11 StartPage: 2280 Subjects: – SubjectFull: Comparative grammar Type: general – SubjectFull: Speech evaluation Type: general – SubjectFull: School children Type: general – SubjectFull: Research Type: general – SubjectFull: Comparative studies Type: general – SubjectFull: Evaluation Type: general – SubjectFull: Descriptive statistics Type: general – SubjectFull: Reliability (Personality trait) Type: general – SubjectFull: Arizona Type: general – SubjectFull: Utah Type: general – SubjectFull: Colorado Type: general Titles: – TitleFull: Examining the Impact of Sample Length on the Reliability of Narrative Retell Language Samples. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Hollis, Jenna – PersonEntity: Name: NameFull: Petersen, Douglas B. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 07 Text: Jul2025 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 10580360 Numbering: – Type: volume Value: 34 – Type: issue Value: 4 Titles: – TitleFull: American Journal of Speech-Language Pathology Type: main |
| ResultId | 1 |
