How Good is Good Enough?: A Comparison of Three Methods for Establishing Cut Scores on Placement Tests.

Saved in:
Bibliographic Details
Title: How Good is Good Enough?: A Comparison of Three Methods for Establishing Cut Scores on Placement Tests.
Authors: Sang-Keun Shin1
Source: English Teaching. Winter2014, Vol. 69 Issue 4, p53-75. 23p.
Subject Terms: *Placement testing, *Test scoring, *Students, *English language education, Cluster analysis (Statistics)
Abstract: The purpose of this study was to determine whether three standard-setting methods would produce sufficiently consistent results for placement decisions. The cut scores were derived from modified Angoff method, borderline group method, and cluster analysis. The results indicate that the cut scores derived from the three standard setting methods did not entirely agree with each other in assigning students into different levels, suggesting that the choice of standard setting method influenced the resulting cut scores. Specifically, the borderline-group method tended to produce lower cut scores than the other two methods. The cluster analysis yielded two cut scores, which were very similar to the cut scores derived from the modified Angoff method at the corresponding levels. The implications of the findings are discussed and avenues for further study are suggested. [ABSTRACT FROM AUTHOR]
Copyright of English Teaching is the property of Korea Association of Teachers of English and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Description
Abstract:The purpose of this study was to determine whether three standard-setting methods would produce sufficiently consistent results for placement decisions. The cut scores were derived from modified Angoff method, borderline group method, and cluster analysis. The results indicate that the cut scores derived from the three standard setting methods did not entirely agree with each other in assigning students into different levels, suggesting that the choice of standard setting method influenced the resulting cut scores. Specifically, the borderline-group method tended to produce lower cut scores than the other two methods. The cluster analysis yielded two cut scores, which were very similar to the cut scores derived from the modified Angoff method at the corresponding levels. The implications of the findings are discussed and avenues for further study are suggested. [ABSTRACT FROM AUTHOR]
ISSN:10177108
DOI:10.15858/engtea.69.4.201412.53