Embedded Standard Setting for Credentialing.

Saved in:
Bibliographic Details
Title: Embedded Standard Setting for Credentialing.
Authors: Lewis, Daniel1 dan.lewis@creativemeasurement.com, Graw, Melanie2 mgraw@restaurant.org, Baker, Michael2 mbaker@restaurant.org
Source: Journal of Applied Testing Technology. 2024, Vol. 25 Issue 1, p1-14. 14p.
Subject Terms: Standard-setting organizations, Descriptor systems
Abstract: Embedded Standard Setting (ESS; Lewis & Cook, 2020) transforms standard setting from a standalone workshop to an active part of the assessment development lifecycle. ESS purports to lower costs by eliminating the standard-setting workshop and enhance the validity argument by maintaining a consistent focus on the evidentiary relationship between test items and their measurement targets throughout the test development lifecycle. ESS is currently employed by multiple K-12 educational state consortia and test publishers to support the coherence of their testing programs and fulfil their standard-setting requirements. A fundamental requirement of ESS is the development of Performance Level Descriptors (PLDs) to explicate the construct across the levels of performance. Formal PLDs are not common in the credentialing industry but the commonly developed Job Task Analysis should be sufficient to support ESS requirements. The current study investigated whether ESS could be adapted for the credentialing industry. The authors describe the methods and results of an ESS pilot study and discuss how credentialing test development practices could be modestly modified to support the application of ESS. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Applied Testing Technology is the property of Association of Test Publishers and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
FullText Links:
  – Type: pdflink
Text:
  Availability: 0
Header DbId: ehh
DbLabel: Education Research Complete
An: 188510533
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Embedded Standard Setting for Credentialing.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Lewis%2C+Daniel%22">Lewis, Daniel</searchLink><relatesTo>1</relatesTo><i> dan.lewis@creativemeasurement.com</i><br /><searchLink fieldCode="AR" term="%22Graw%2C+Melanie%22">Graw, Melanie</searchLink><relatesTo>2</relatesTo><i> mgraw@restaurant.org</i><br /><searchLink fieldCode="AR" term="%22Baker%2C+Michael%22">Baker, Michael</searchLink><relatesTo>2</relatesTo><i> mbaker@restaurant.org</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Applied+Testing+Technology%22">Journal of Applied Testing Technology</searchLink>. 2024, Vol. 25 Issue 1, p1-14. 14p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Standard-setting+organizations%22">Standard-setting organizations</searchLink><br /><searchLink fieldCode="DE" term="%22Descriptor+systems%22">Descriptor systems</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Embedded Standard Setting (ESS; Lewis & Cook, 2020) transforms standard setting from a standalone workshop to an active part of the assessment development lifecycle. ESS purports to lower costs by eliminating the standard-setting workshop and enhance the validity argument by maintaining a consistent focus on the evidentiary relationship between test items and their measurement targets throughout the test development lifecycle. ESS is currently employed by multiple K-12 educational state consortia and test publishers to support the coherence of their testing programs and fulfil their standard-setting requirements. A fundamental requirement of ESS is the development of Performance Level Descriptors (PLDs) to explicate the construct across the levels of performance. Formal PLDs are not common in the credentialing industry but the commonly developed Job Task Analysis should be sufficient to support ESS requirements. The current study investigated whether ESS could be adapted for the credentialing industry. The authors describe the methods and results of an ESS pilot study and discuss how credentialing test development practices could be modestly modified to support the application of ESS. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Applied Testing Technology is the property of Association of Test Publishers and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=188510533
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 1
    Subjects:
      – SubjectFull: Standard-setting organizations
        Type: general
      – SubjectFull: Descriptor systems
        Type: general
    Titles:
      – TitleFull: Embedded Standard Setting for Credentialing.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Lewis, Daniel
      – PersonEntity:
          Name:
            NameFull: Graw, Melanie
      – PersonEntity:
          Name:
            NameFull: Baker, Michael
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Text: 2024
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 23755636
          Numbering:
            – Type: volume
              Value: 25
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Journal of Applied Testing Technology
              Type: main
ResultId 1