Interrater reliability in neurology objective structured clinical examination across specialties.
Saved in:
| Title: | Interrater reliability in neurology objective structured clinical examination across specialties. |
|---|---|
| Authors: | Mechtouff, Laura1 (AUTHOR) laura.mechtouff@chu-lyon.fr, Balanca, Baptiste2 (AUTHOR), Jung, Julien3 (AUTHOR), Bourgeois-Vionnet, Julie3 (AUTHOR), Dumot, Chloé4 (AUTHOR), Guery, Déborah3 (AUTHOR), Picart, Thiébaud5 (AUTHOR), Bapteste, Lionel2 (AUTHOR), Demarquay, Geneviève3 (AUTHOR), Bani-Sadr, Alexandre6 (AUTHOR), Rascle, Lucie1 (AUTHOR), Berthezène, Yves6 (AUTHOR), Jacquesson, Timothée5 (AUTHOR), Amaz, Camille7 (AUTHOR), Macabrey, Juliette8 (AUTHOR), Ramos, Inès8 (AUTHOR), Viprey, Marie8 (AUTHOR), Rode, Gilles9 (AUTHOR), Cortet, Marion10 (AUTHOR) |
| Source: | Medical Teacher. Feb2024, Vol. 46 Issue 2, p239-244. 6p. |
| Subject Terms: | *Occupational roles, *Inter-observer reliability, *Educational tests & measurements, *Clinical competence, *Educators, *Evaluation, Neurology, Confidence intervals, Multivariate analysis, Regression analysis, Intraclass correlation, Neurologic examination, Medical specialties & specialists, Video recording |
| Geographic Terms: | France |
| Abstract: | To assess interrater reliability and examiners' characteristics, especially specialty, associated with scoring of neurology objective structured clinical examination (OSCE). During a neurology mock OSCE, five randomly chosen students volunteers were filmed while performing 1 of the 5 stations. Video recordings were scored by physicians from the Lyon and Clermont-Ferrand university teaching hospitals to assess students performance using both a checklist scoring and a global rating scale. Interrater reliability between examiners were assessed using intraclass coefficient correlation. Multivariable linear regression models including video recording as random effect dependent variable were performed to detect factors associated with scoring. Thirty examiners including 15 (50%) neurologists participated. The intraclass correlation coefficient of checklist scores and global ratings between examiners were 0.71 (CI95% [0.45-0.95]) and 0.54 (CI95% [0.28-0.91]), respectively. In multivariable analyses, no factor was associated with checklist scores, while male gender of examiner was associated with lower global rating (β coefficient = –0.37; CI 95% [–0.62–0.11]). Our study demonstrated through a video-based scoring method that agreement among examiners was good using checklist scoring while moderate using global rating scale in neurology OSCE. Examiner's specialty did not affect scoring whereas gender was associated with global rating scale. [ABSTRACT FROM AUTHOR] |
| Copyright of Medical Teacher is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | To assess interrater reliability and examiners' characteristics, especially specialty, associated with scoring of neurology objective structured clinical examination (OSCE). During a neurology mock OSCE, five randomly chosen students volunteers were filmed while performing 1 of the 5 stations. Video recordings were scored by physicians from the Lyon and Clermont-Ferrand university teaching hospitals to assess students performance using both a checklist scoring and a global rating scale. Interrater reliability between examiners were assessed using intraclass coefficient correlation. Multivariable linear regression models including video recording as random effect dependent variable were performed to detect factors associated with scoring. Thirty examiners including 15 (50%) neurologists participated. The intraclass correlation coefficient of checklist scores and global ratings between examiners were 0.71 (CI95% [0.45-0.95]) and 0.54 (CI95% [0.28-0.91]), respectively. In multivariable analyses, no factor was associated with checklist scores, while male gender of examiner was associated with lower global rating (β coefficient = –0.37; CI 95% [–0.62–0.11]). Our study demonstrated through a video-based scoring method that agreement among examiners was good using checklist scoring while moderate using global rating scale in neurology OSCE. Examiner's specialty did not affect scoring whereas gender was associated with global rating scale. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 0142159X |
| DOI: | 10.1080/0142159X.2023.2244146 |
