View in EDS HTML Full Text PDF Full Text

Using Process Data to Evaluate the Impact of Shortening Allotted Case Time in a Simulation‐Based Assessment.

Saved in:
Bibliographic Details
Title: Using Process Data to Evaluate the Impact of Shortening Allotted Case Time in a Simulation‐Based Assessment.
Authors: Liu, Chunyan1 (AUTHOR), Cuddy, Monica M.1 (AUTHOR), He, Qiwei2 (AUTHOR), Ouyang, Wenli1 (AUTHOR), Artman, Cara1 (AUTHOR)
Source: Educational Measurement: Issues & Practice. Dec2024, Vol. 43 Issue 4, p24-32. 9p.
Subject Terms: Timestamps, Physicians, Percentiles
Abstract: The Computer‐based Case Simulations (CCS) component of the United States Medical Licensing Examination (USMLE) Step 3 was developed to assess the decision‐making and patient‐management skills of physicians. Process data can provide deep insights into examinees' behavioral processes related to completing the CCS assessment task. In this paper, we utilized process data to evaluate the impact of shortening allotted time limit by rescoring the CCS cases based on process data extracted at various timestamps that represented different percentages of the original allotted case time. It was found that examinees' performance as well as the correlation between original and newly generated scores both tended to decrease as the timestamp condition became stricter. The impact of shortening allotted time limit was found marginally associated with case difficulties, but strongly dependent on the case time intensity under the original time setting. [ABSTRACT FROM AUTHOR]
Copyright of Educational Measurement: Issues & Practice is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: ehh
DbLabel: Education Research Complete
An: 182049111
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Using Process Data to Evaluate the Impact of Shortening Allotted Case Time in a Simulation‐Based Assessment.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Liu%2C+Chunyan%22">Liu, Chunyan</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Cuddy%2C+Monica+M%2E%22">Cuddy, Monica M.</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22He%2C+Qiwei%22">He, Qiwei</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Ouyang%2C+Wenli%22">Ouyang, Wenli</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Artman%2C+Cara%22">Artman, Cara</searchLink><relatesTo>1</relatesTo> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Educational+Measurement%3A+Issues+%26+Practice%22">Educational Measurement: Issues & Practice</searchLink>. Dec2024, Vol. 43 Issue 4, p24-32. 9p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Timestamps%22">Timestamps</searchLink><br /><searchLink fieldCode="DE" term="%22Physicians%22">Physicians</searchLink><br /><searchLink fieldCode="DE" term="%22Percentiles%22">Percentiles</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The Computer‐based Case Simulations (CCS) component of the United States Medical Licensing Examination (USMLE) Step 3 was developed to assess the decision‐making and patient‐management skills of physicians. Process data can provide deep insights into examinees' behavioral processes related to completing the CCS assessment task. In this paper, we utilized process data to evaluate the impact of shortening allotted time limit by rescoring the CCS cases based on process data extracted at various timestamps that represented different percentages of the original allotted case time. It was found that examinees' performance as well as the correlation between original and newly generated scores both tended to decrease as the timestamp condition became stricter. The impact of shortening allotted time limit was found marginally associated with case difficulties, but strongly dependent on the case time intensity under the original time setting. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Educational Measurement: Issues & Practice is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=182049111
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1111/emip.12656
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 9
        StartPage: 24
    Subjects:
      – SubjectFull: Timestamps
        Type: general
      – SubjectFull: Physicians
        Type: general
      – SubjectFull: Percentiles
        Type: general
    Titles:
      – TitleFull: Using Process Data to Evaluate the Impact of Shortening Allotted Case Time in a Simulation‐Based Assessment.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Liu, Chunyan
      – PersonEntity:
          Name:
            NameFull: Cuddy, Monica M.
      – PersonEntity:
          Name:
            NameFull: He, Qiwei
      – PersonEntity:
          Name:
            NameFull: Ouyang, Wenli
      – PersonEntity:
          Name:
            NameFull: Artman, Cara
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Text: Dec2024
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 07311745
          Numbering:
            – Type: volume
              Value: 43
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: Educational Measurement: Issues & Practice
              Type: main
ResultId 1