View in EDS HTML Full Text PDF Full Text

Interrater reliability in neurology objective structured clinical examination across specialties.

Saved in:
Bibliographic Details
Title: Interrater reliability in neurology objective structured clinical examination across specialties.
Authors: Mechtouff, Laura1 (AUTHOR) laura.mechtouff@chu-lyon.fr, Balanca, Baptiste2 (AUTHOR), Jung, Julien3 (AUTHOR), Bourgeois-Vionnet, Julie3 (AUTHOR), Dumot, Chloé4 (AUTHOR), Guery, Déborah3 (AUTHOR), Picart, Thiébaud5 (AUTHOR), Bapteste, Lionel2 (AUTHOR), Demarquay, Geneviève3 (AUTHOR), Bani-Sadr, Alexandre6 (AUTHOR), Rascle, Lucie1 (AUTHOR), Berthezène, Yves6 (AUTHOR), Jacquesson, Timothée5 (AUTHOR), Amaz, Camille7 (AUTHOR), Macabrey, Juliette8 (AUTHOR), Ramos, Inès8 (AUTHOR), Viprey, Marie8 (AUTHOR), Rode, Gilles9 (AUTHOR), Cortet, Marion10 (AUTHOR)
Source: Medical Teacher. Feb2024, Vol. 46 Issue 2, p239-244. 6p.
Subject Terms: *Occupational roles, *Inter-observer reliability, *Educational tests & measurements, *Clinical competence, *Educators, *Evaluation, Neurology, Confidence intervals, Multivariate analysis, Regression analysis, Intraclass correlation, Neurologic examination, Medical specialties & specialists, Video recording
Geographic Terms: France
Abstract: To assess interrater reliability and examiners' characteristics, especially specialty, associated with scoring of neurology objective structured clinical examination (OSCE). During a neurology mock OSCE, five randomly chosen students volunteers were filmed while performing 1 of the 5 stations. Video recordings were scored by physicians from the Lyon and Clermont-Ferrand university teaching hospitals to assess students performance using both a checklist scoring and a global rating scale. Interrater reliability between examiners were assessed using intraclass coefficient correlation. Multivariable linear regression models including video recording as random effect dependent variable were performed to detect factors associated with scoring. Thirty examiners including 15 (50%) neurologists participated. The intraclass correlation coefficient of checklist scores and global ratings between examiners were 0.71 (CI95% [0.45-0.95]) and 0.54 (CI95% [0.28-0.91]), respectively. In multivariable analyses, no factor was associated with checklist scores, while male gender of examiner was associated with lower global rating (β coefficient = –0.37; CI 95% [–0.62–0.11]). Our study demonstrated through a video-based scoring method that agreement among examiners was good using checklist scoring while moderate using global rating scale in neurology OSCE. Examiner's specialty did not affect scoring whereas gender was associated with global rating scale. [ABSTRACT FROM AUTHOR]
Copyright of Medical Teacher is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: ehh
DbLabel: Education Research Complete
An: 175497404
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Interrater reliability in neurology objective structured clinical examination across specialties.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Mechtouff%2C+Laura%22">Mechtouff, Laura</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> laura.mechtouff@chu-lyon.fr</i><br /><searchLink fieldCode="AR" term="%22Balanca%2C+Baptiste%22">Balanca, Baptiste</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Jung%2C+Julien%22">Jung, Julien</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Bourgeois-Vionnet%2C+Julie%22">Bourgeois-Vionnet, Julie</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Dumot%2C+Chloé%22">Dumot, Chloé</searchLink><relatesTo>4</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Guery%2C+Déborah%22">Guery, Déborah</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Picart%2C+Thiébaud%22">Picart, Thiébaud</searchLink><relatesTo>5</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Bapteste%2C+Lionel%22">Bapteste, Lionel</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Demarquay%2C+Geneviève%22">Demarquay, Geneviève</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Bani-Sadr%2C+Alexandre%22">Bani-Sadr, Alexandre</searchLink><relatesTo>6</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Rascle%2C+Lucie%22">Rascle, Lucie</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Berthezène%2C+Yves%22">Berthezène, Yves</searchLink><relatesTo>6</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Jacquesson%2C+Timothée%22">Jacquesson, Timothée</searchLink><relatesTo>5</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Amaz%2C+Camille%22">Amaz, Camille</searchLink><relatesTo>7</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Macabrey%2C+Juliette%22">Macabrey, Juliette</searchLink><relatesTo>8</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Ramos%2C+Inès%22">Ramos, Inès</searchLink><relatesTo>8</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Viprey%2C+Marie%22">Viprey, Marie</searchLink><relatesTo>8</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Rode%2C+Gilles%22">Rode, Gilles</searchLink><relatesTo>9</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Cortet%2C+Marion%22">Cortet, Marion</searchLink><relatesTo>10</relatesTo> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Medical+Teacher%22">Medical Teacher</searchLink>. Feb2024, Vol. 46 Issue 2, p239-244. 6p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Occupational+roles%22">Occupational roles</searchLink><br />*<searchLink fieldCode="DE" term="%22Inter-observer+reliability%22">Inter-observer reliability</searchLink><br />*<searchLink fieldCode="DE" term="%22Educational+tests+%26+measurements%22">Educational tests & measurements</searchLink><br />*<searchLink fieldCode="DE" term="%22Clinical+competence%22">Clinical competence</searchLink><br />*<searchLink fieldCode="DE" term="%22Educators%22">Educators</searchLink><br />*<searchLink fieldCode="DE" term="%22Evaluation%22">Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Neurology%22">Neurology</searchLink><br /><searchLink fieldCode="DE" term="%22Confidence+intervals%22">Confidence intervals</searchLink><br /><searchLink fieldCode="DE" term="%22Multivariate+analysis%22">Multivariate analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Regression+analysis%22">Regression analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Intraclass+correlation%22">Intraclass correlation</searchLink><br /><searchLink fieldCode="DE" term="%22Neurologic+examination%22">Neurologic examination</searchLink><br /><searchLink fieldCode="DE" term="%22Medical+specialties+%26+specialists%22">Medical specialties & specialists</searchLink><br /><searchLink fieldCode="DE" term="%22Video+recording%22">Video recording</searchLink>
– Name: SubjectGeographic
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22France%22">France</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: To assess interrater reliability and examiners' characteristics, especially specialty, associated with scoring of neurology objective structured clinical examination (OSCE). During a neurology mock OSCE, five randomly chosen students volunteers were filmed while performing 1 of the 5 stations. Video recordings were scored by physicians from the Lyon and Clermont-Ferrand university teaching hospitals to assess students performance using both a checklist scoring and a global rating scale. Interrater reliability between examiners were assessed using intraclass coefficient correlation. Multivariable linear regression models including video recording as random effect dependent variable were performed to detect factors associated with scoring. Thirty examiners including 15 (50%) neurologists participated. The intraclass correlation coefficient of checklist scores and global ratings between examiners were 0.71 (CI95% [0.45-0.95]) and 0.54 (CI95% [0.28-0.91]), respectively. In multivariable analyses, no factor was associated with checklist scores, while male gender of examiner was associated with lower global rating (β coefficient = –0.37; CI 95% [–0.62–0.11]). Our study demonstrated through a video-based scoring method that agreement among examiners was good using checklist scoring while moderate using global rating scale in neurology OSCE. Examiner's specialty did not affect scoring whereas gender was associated with global rating scale. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Medical Teacher is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=175497404
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/0142159X.2023.2244146
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 6
        StartPage: 239
    Subjects:
      – SubjectFull: Occupational roles
        Type: general
      – SubjectFull: Inter-observer reliability
        Type: general
      – SubjectFull: Educational tests & measurements
        Type: general
      – SubjectFull: Clinical competence
        Type: general
      – SubjectFull: Educators
        Type: general
      – SubjectFull: Evaluation
        Type: general
      – SubjectFull: Neurology
        Type: general
      – SubjectFull: Confidence intervals
        Type: general
      – SubjectFull: Multivariate analysis
        Type: general
      – SubjectFull: Regression analysis
        Type: general
      – SubjectFull: Intraclass correlation
        Type: general
      – SubjectFull: Neurologic examination
        Type: general
      – SubjectFull: Medical specialties & specialists
        Type: general
      – SubjectFull: Video recording
        Type: general
      – SubjectFull: France
        Type: general
    Titles:
      – TitleFull: Interrater reliability in neurology objective structured clinical examination across specialties.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Mechtouff, Laura
      – PersonEntity:
          Name:
            NameFull: Balanca, Baptiste
      – PersonEntity:
          Name:
            NameFull: Jung, Julien
      – PersonEntity:
          Name:
            NameFull: Bourgeois-Vionnet, Julie
      – PersonEntity:
          Name:
            NameFull: Dumot, Chloé
      – PersonEntity:
          Name:
            NameFull: Guery, Déborah
      – PersonEntity:
          Name:
            NameFull: Picart, Thiébaud
      – PersonEntity:
          Name:
            NameFull: Bapteste, Lionel
      – PersonEntity:
          Name:
            NameFull: Demarquay, Geneviève
      – PersonEntity:
          Name:
            NameFull: Bani-Sadr, Alexandre
      – PersonEntity:
          Name:
            NameFull: Rascle, Lucie
      – PersonEntity:
          Name:
            NameFull: Berthezène, Yves
      – PersonEntity:
          Name:
            NameFull: Jacquesson, Timothée
      – PersonEntity:
          Name:
            NameFull: Amaz, Camille
      – PersonEntity:
          Name:
            NameFull: Macabrey, Juliette
      – PersonEntity:
          Name:
            NameFull: Ramos, Inès
      – PersonEntity:
          Name:
            NameFull: Viprey, Marie
      – PersonEntity:
          Name:
            NameFull: Rode, Gilles
      – PersonEntity:
          Name:
            NameFull: Cortet, Marion
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 02
              Text: Feb2024
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 0142159X
          Numbering:
            – Type: volume
              Value: 46
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Medical Teacher
              Type: main
ResultId 1