Embedded Standard Setting for Credentialing.

Saved in:

Bibliographic Details
Title:	Embedded Standard Setting for Credentialing.
Authors:	Lewis, Daniel¹ dan.lewis@creativemeasurement.com, Graw, Melanie² mgraw@restaurant.org, Baker, Michael² mbaker@restaurant.org
Source:	Journal of Applied Testing Technology. 2024, Vol. 25 Issue 1, p1-14. 14p.
Subject Terms:	Standard-setting organizations, Descriptor systems
Abstract:	Embedded Standard Setting (ESS; Lewis & Cook, 2020) transforms standard setting from a standalone workshop to an active part of the assessment development lifecycle. ESS purports to lower costs by eliminating the standard-setting workshop and enhance the validity argument by maintaining a consistent focus on the evidentiary relationship between test items and their measurement targets throughout the test development lifecycle. ESS is currently employed by multiple K-12 educational state consortia and test publishers to support the coherence of their testing programs and fulfil their standard-setting requirements. A fundamental requirement of ESS is the development of Performance Level Descriptors (PLDs) to explicate the construct across the levels of performance. Formal PLDs are not common in the credentialing industry but the commonly developed Job Task Analysis should be sufficient to support ESS requirements. The current study investigated whether ESS could be adapted for the credentialing industry. The authors describe the methods and results of an ESS pilot study and discuss how credentialing test development practices could be modestly modified to support the application of ESS. [ABSTRACT FROM AUTHOR]
	Copyright of Journal of Applied Testing Technology is the property of Association of Test Publishers and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database:	Education Research Complete

Description
Abstract:	Embedded Standard Setting (ESS; Lewis & Cook, 2020) transforms standard setting from a standalone workshop to an active part of the assessment development lifecycle. ESS purports to lower costs by eliminating the standard-setting workshop and enhance the validity argument by maintaining a consistent focus on the evidentiary relationship between test items and their measurement targets throughout the test development lifecycle. ESS is currently employed by multiple K-12 educational state consortia and test publishers to support the coherence of their testing programs and fulfil their standard-setting requirements. A fundamental requirement of ESS is the development of Performance Level Descriptors (PLDs) to explicate the construct across the levels of performance. Formal PLDs are not common in the credentialing industry but the commonly developed Job Task Analysis should be sufficient to support ESS requirements. The current study investigated whether ESS could be adapted for the credentialing industry. The authors describe the methods and results of an ESS pilot study and discuss how credentialing test development practices could be modestly modified to support the application of ESS. [ABSTRACT FROM AUTHOR]
ISSN:	23755636