Embedded Standard Setting for Credentialing.
Saved in:
| Title: | Embedded Standard Setting for Credentialing. |
|---|---|
| Authors: | Lewis, Daniel1 dan.lewis@creativemeasurement.com, Graw, Melanie2 mgraw@restaurant.org, Baker, Michael2 mbaker@restaurant.org |
| Source: | Journal of Applied Testing Technology. 2024, Vol. 25 Issue 1, p1-14. 14p. |
| Subject Terms: | Standard-setting organizations, Descriptor systems |
| Abstract: | Embedded Standard Setting (ESS; Lewis & Cook, 2020) transforms standard setting from a standalone workshop to an active part of the assessment development lifecycle. ESS purports to lower costs by eliminating the standard-setting workshop and enhance the validity argument by maintaining a consistent focus on the evidentiary relationship between test items and their measurement targets throughout the test development lifecycle. ESS is currently employed by multiple K-12 educational state consortia and test publishers to support the coherence of their testing programs and fulfil their standard-setting requirements. A fundamental requirement of ESS is the development of Performance Level Descriptors (PLDs) to explicate the construct across the levels of performance. Formal PLDs are not common in the credentialing industry but the commonly developed Job Task Analysis should be sufficient to support ESS requirements. The current study investigated whether ESS could be adapted for the credentialing industry. The authors describe the methods and results of an ESS pilot study and discuss how credentialing test development practices could be modestly modified to support the application of ESS. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Applied Testing Technology is the property of Association of Test Publishers and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 188510533 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Embedded Standard Setting for Credentialing. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Lewis%2C+Daniel%22">Lewis, Daniel</searchLink><relatesTo>1</relatesTo><i> dan.lewis@creativemeasurement.com</i><br /><searchLink fieldCode="AR" term="%22Graw%2C+Melanie%22">Graw, Melanie</searchLink><relatesTo>2</relatesTo><i> mgraw@restaurant.org</i><br /><searchLink fieldCode="AR" term="%22Baker%2C+Michael%22">Baker, Michael</searchLink><relatesTo>2</relatesTo><i> mbaker@restaurant.org</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Journal+of+Applied+Testing+Technology%22">Journal of Applied Testing Technology</searchLink>. 2024, Vol. 25 Issue 1, p1-14. 14p. – Name: Subject Label: Subject Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Standard-setting+organizations%22">Standard-setting organizations</searchLink><br /><searchLink fieldCode="DE" term="%22Descriptor+systems%22">Descriptor systems</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Embedded Standard Setting (ESS; Lewis & Cook, 2020) transforms standard setting from a standalone workshop to an active part of the assessment development lifecycle. ESS purports to lower costs by eliminating the standard-setting workshop and enhance the validity argument by maintaining a consistent focus on the evidentiary relationship between test items and their measurement targets throughout the test development lifecycle. ESS is currently employed by multiple K-12 educational state consortia and test publishers to support the coherence of their testing programs and fulfil their standard-setting requirements. A fundamental requirement of ESS is the development of Performance Level Descriptors (PLDs) to explicate the construct across the levels of performance. Formal PLDs are not common in the credentialing industry but the commonly developed Job Task Analysis should be sufficient to support ESS requirements. The current study investigated whether ESS could be adapted for the credentialing industry. The authors describe the methods and results of an ESS pilot study and discuss how credentialing test development practices could be modestly modified to support the application of ESS. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Journal of Applied Testing Technology is the property of Association of Test Publishers and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=188510533 |
| RecordInfo | BibRecord: BibEntity: Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 14 StartPage: 1 Subjects: – SubjectFull: Standard-setting organizations Type: general – SubjectFull: Descriptor systems Type: general Titles: – TitleFull: Embedded Standard Setting for Credentialing. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Lewis, Daniel – PersonEntity: Name: NameFull: Graw, Melanie – PersonEntity: Name: NameFull: Baker, Michael IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Text: 2024 Type: published Y: 2024 Identifiers: – Type: issn-print Value: 23755636 Numbering: – Type: volume Value: 25 – Type: issue Value: 1 Titles: – TitleFull: Journal of Applied Testing Technology Type: main |
| ResultId | 1 |