Digital Module 18: Automated Scoring https://ncme.elevate.commpartners.com.
Saved in:
| Title: | Digital Module 18: Automated Scoring https://ncme.elevate.commpartners.com. |
|---|---|
| Authors: | Lottridge, Sue1 (AUTHOR), Burkhardt, Amy2 (AUTHOR), Boyer, Michelle3 (AUTHOR) |
| Source: | Educational Measurement: Issues & Practice. Fall2020, Vol. 39 Issue 3, p141-142. 2p. |
| Subject Terms: | *Educational tests & measurements, *Algorithms, Web-based user interfaces, Logical prediction, Hyperlinks |
| Abstract: | In this digital ITEMS module, Dr. Sue Lottridge, Amy Burkhardt, and Dr. Michelle Boyer provide an overview of automated scoring. Automated scoring is the use of computer algorithms to score unconstrained open‐ended test items by mimicking human scoring. The use of automated scoring is increasing in educational assessment programs because it allows scores to be returned faster at lower cost. In the module, they discuss automated scoring from a number of perspectives. First, they discuss benefits and weaknesses of automated scoring, and what psychometricians should know about automated scoring. Next, they describe the overall process of automated scoring, moving from data collection to engine training to operational scoring. Then, they describe how automated scoring systems work, including the basic functions around score prediction as well as other flagging methods. Finally, they conclude with a discussion of the specific validity demands around automated scoring and how they align with the larger validity demands around test scores. Two data activities are provided. The first is an interactive activity that allows the user to train and evaluate a simple automated scoring engine. The second is a worked example that examines the impact of rater error on test scores. The digital module contains a link to an interactive web application as well as its R‐Shiny code, diagnostic quiz questions, activities, curated resources, and a glossary. [ABSTRACT FROM AUTHOR] |
| Copyright of Educational Measurement: Issues & Practice is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
|
Full text is not displayed to guests.
Login for full access.
|
|
Be the first to leave a comment!
