Feasibility and Reliability of the Adapted Kagan Scales for Rating Conversations for People With Acquired Brain Injury: A Multiphase Iterative Mixed-Methods Design.
Saved in:
| Title: | Feasibility and Reliability of the Adapted Kagan Scales for Rating Conversations for People With Acquired Brain Injury: A Multiphase Iterative Mixed-Methods Design. |
|---|---|
| Authors: | Behn, Nicholas1 Nicholas.behn@city.ac.uk, Power, Emma2, Prodger, Penny1, Togher, Leanne3, Cruice, Madeline1, Marshall, Jane1, Rietdijk, Rachael3 |
| Source: | American Journal of Speech-Language Pathology. Jun2025, Vol. 34, p1754-1769. 16p. |
| Subject Terms: | *Speech therapists, *Health occupations students, *Communicative disorders, *Communication, *Research methodology, Scale analysis (Psychology), Pilot projects, Brain injuries, Physicians, Confidence intervals, Reliability (Personality trait), Video recording |
| Abstract: | Purpose: Rating the quality of conversations can assess communication skills in both people with acquired brain injury and their communication partners. This study explored the clinical feasibility and reliability of two conversation rating scales: the Adapted Measure of Participation in Conversation (MPC) and the Adapted Measure of Support in Conversation (MSC). Method: Raters were final-year speech and language therapy students (n = 14) and qualified clinicians (n = 2). Raters attended training on the Adapted MPC and MSC, watched 5 or 10 min of videotaped conversations (n = 23), and then scored them on the MPC and MSC scales. Data were collected over four phases, which varied according to the length of the training, sample length, number of samples rated, and level of clinical expertise. Feasibility data (time taken to score conversations and ease of use) were collected. Interrater reliability was assessed using intraclass correlations (ICCs: absolute agreement, single measures). Results: Raters took 30-45 min to score a 10-min sample, and they took 20-30 min to score a 5-min sample. Ease of use was rated highly across all phases. Overall reliability for rating 5 min of conversation (ICC = .52-.73) was better than for 10 min of conversation (ICC = .33-.68). Reliability for the MPC was moderate for both students (ICC = .69) and clinicians (ICC = .55), and for the MSC, it was moderate for both students (ICC = .73) and clinicians (ICC = .58). Reliability was better for students compared with clinicians. Conclusions: Rating a 5-min conversation in under 30 min was feasible, with more reliable results for 5-min compared with 10-min conversations. Implications for assessing conversation in the future are discussed. [ABSTRACT FROM AUTHOR] |
| Copyright of American Journal of Speech-Language Pathology is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 186264114 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Feasibility and Reliability of the Adapted Kagan Scales for Rating Conversations for People With Acquired Brain Injury: A Multiphase Iterative Mixed-Methods Design. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Behn%2C+Nicholas%22">Behn, Nicholas</searchLink><relatesTo>1</relatesTo><i> Nicholas.behn@city.ac.uk</i><br /><searchLink fieldCode="AR" term="%22Power%2C+Emma%22">Power, Emma</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Prodger%2C+Penny%22">Prodger, Penny</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Togher%2C+Leanne%22">Togher, Leanne</searchLink><relatesTo>3</relatesTo><br /><searchLink fieldCode="AR" term="%22Cruice%2C+Madeline%22">Cruice, Madeline</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Marshall%2C+Jane%22">Marshall, Jane</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Rietdijk%2C+Rachael%22">Rietdijk, Rachael</searchLink><relatesTo>3</relatesTo> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22American+Journal+of+Speech-Language+Pathology%22">American Journal of Speech-Language Pathology</searchLink>. Jun2025, Vol. 34, p1754-1769. 16p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Speech+therapists%22">Speech therapists</searchLink><br />*<searchLink fieldCode="DE" term="%22Health+occupations+students%22">Health occupations students</searchLink><br />*<searchLink fieldCode="DE" term="%22Communicative+disorders%22">Communicative disorders</searchLink><br />*<searchLink fieldCode="DE" term="%22Communication%22">Communication</searchLink><br />*<searchLink fieldCode="DE" term="%22Research+methodology%22">Research methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Scale+analysis+%28Psychology%29%22">Scale analysis (Psychology)</searchLink><br /><searchLink fieldCode="DE" term="%22Pilot+projects%22">Pilot projects</searchLink><br /><searchLink fieldCode="DE" term="%22Brain+injuries%22">Brain injuries</searchLink><br /><searchLink fieldCode="DE" term="%22Physicians%22">Physicians</searchLink><br /><searchLink fieldCode="DE" term="%22Confidence+intervals%22">Confidence intervals</searchLink><br /><searchLink fieldCode="DE" term="%22Reliability+%28Personality+trait%29%22">Reliability (Personality trait)</searchLink><br /><searchLink fieldCode="DE" term="%22Video+recording%22">Video recording</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Purpose: Rating the quality of conversations can assess communication skills in both people with acquired brain injury and their communication partners. This study explored the clinical feasibility and reliability of two conversation rating scales: the Adapted Measure of Participation in Conversation (MPC) and the Adapted Measure of Support in Conversation (MSC). Method: Raters were final-year speech and language therapy students (n = 14) and qualified clinicians (n = 2). Raters attended training on the Adapted MPC and MSC, watched 5 or 10 min of videotaped conversations (n = 23), and then scored them on the MPC and MSC scales. Data were collected over four phases, which varied according to the length of the training, sample length, number of samples rated, and level of clinical expertise. Feasibility data (time taken to score conversations and ease of use) were collected. Interrater reliability was assessed using intraclass correlations (ICCs: absolute agreement, single measures). Results: Raters took 30-45 min to score a 10-min sample, and they took 20-30 min to score a 5-min sample. Ease of use was rated highly across all phases. Overall reliability for rating 5 min of conversation (ICC = .52-.73) was better than for 10 min of conversation (ICC = .33-.68). Reliability for the MPC was moderate for both students (ICC = .69) and clinicians (ICC = .55), and for the MSC, it was moderate for both students (ICC = .73) and clinicians (ICC = .58). Reliability was better for students compared with clinicians. Conclusions: Rating a 5-min conversation in under 30 min was feasible, with more reliable results for 5-min compared with 10-min conversations. Implications for assessing conversation in the future are discussed. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of American Journal of Speech-Language Pathology is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=186264114 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1044/2024_AJSLP-24-00144 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 16 StartPage: 1754 Subjects: – SubjectFull: Speech therapists Type: general – SubjectFull: Health occupations students Type: general – SubjectFull: Communicative disorders Type: general – SubjectFull: Communication Type: general – SubjectFull: Research methodology Type: general – SubjectFull: Scale analysis (Psychology) Type: general – SubjectFull: Pilot projects Type: general – SubjectFull: Brain injuries Type: general – SubjectFull: Physicians Type: general – SubjectFull: Confidence intervals Type: general – SubjectFull: Reliability (Personality trait) Type: general – SubjectFull: Video recording Type: general Titles: – TitleFull: Feasibility and Reliability of the Adapted Kagan Scales for Rating Conversations for People With Acquired Brain Injury: A Multiphase Iterative Mixed-Methods Design. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Behn, Nicholas – PersonEntity: Name: NameFull: Power, Emma – PersonEntity: Name: NameFull: Prodger, Penny – PersonEntity: Name: NameFull: Togher, Leanne – PersonEntity: Name: NameFull: Cruice, Madeline – PersonEntity: Name: NameFull: Marshall, Jane – PersonEntity: Name: NameFull: Rietdijk, Rachael IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 06 Text: Jun2025 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 10580360 Numbering: – Type: volume Value: 34 Titles: – TitleFull: American Journal of Speech-Language Pathology Type: main |
| ResultId | 1 |
