View in EDS

Charting the Future of Assessments. Full Report

Saved in:
Bibliographic Details
Title: Charting the Future of Assessments. Full Report
Language: English
Authors: Patrick C. Kyllonen, Amit Sevak, Teresa Ober, Ikkyu Choi, Jesse Sparks, Daniel Fishtein, Educational Testing Service (ETS)
Source: ETS Research Institute. 2024.
Availability: ETS Research Institute. Available from: Educational Testing Service. Rosedale Road Mailstop 13E, Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; Web site: https://www.ets.org/research.html
Peer Reviewed: N
Page Count: 72
Publication Date: 2024
Document Type: Reports - Evaluative
Descriptors: Performance Based Assessment, Evaluation Criteria, Evaluation Methods, Test Bias, Test Construction, Test Content, Test Reliability, Test Validity, Standards, Student Evaluation, Personnel Evaluation, Error of Measurement, Information Security, Computer Assisted Testing, Skill Development, Feedback (Response), Long Range Planning, Strategic Planning
Abstract: Assessment refers to a broad array of approaches for measuring or evaluating a person's (or group of persons') skills, behaviors, dispositions, or other attributes. Assessments range from standardized tests used in admissions, employee selection, licensure examinations, and domestic and international largescale assessments of cognitive and behavioral skills to formative K-12 classroom curricular assessments. The various types of assessments are used for a wide variety of purposes, but they also have many common elements, such as standards for their reliability, validity, and fairness--even classroom assessments have standards (Klinger et al., 2015). The authors believe the future of assessments will involve a shift in emphasis on what skills will be measured, innovations in how one goes about measuring them, the use of advanced technologies for test operations, and an expansion in the value and kinds of information that test-takers will receive from taking the assessment. In this paper, the authors argue and provide evidence for the belief that the future of assessment contains challenges but is promising. The challenges include risks associated with security and exposure of personal data, test score bias, and inappropriate test uses, all of which may be exacerbated by the growing infiltration of artificial intelligence (AI) into people's lives. The promise is increasing opportunities for testing to help individuals achieve their education and career goals and contribute to well-being and overall quality of life. To help achieve this promise the authors focus on the evidence-based science of measurement in education and workplace learning, a theme throughout this paper. The first section of the paper reviews evidence for the value of assessment and discusses how the role of assessment may expand as skills become the new currency. The many purposes of assessment are discussed, from high-stakes examinations and selection tests to low-stakes formative assessments. The emerging challenges to testing and assessment, related to perceptions about their value, their focus, validity, fairness and equity concerns, are reviewed. The authors conclude the first section with a discussion of the prospects for the future of assessments, including the capacity of assessment to provide useful information to test-takers, the importance of identifying key skills and advancing methods for assessing hard-to-measure skills, and the importance of providing opportunities with personalized feedback. The remaining sections of the paper address those themes. The intended audience for this report is broad-ranging from the international scientific community in areas engaged in assessment, particularly education and workforce, to policy-makers and funders in those areas. The authors try to strike a balance between technical detail and accessibility to the broad audience.
Abstractor: ERIC
Entry Date: 2024
Accession Number: ED660962
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED660962
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED660962
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Charting the Future of Assessments. Full Report
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Patrick+C%2E+Kyllonen%22">Patrick C. Kyllonen</searchLink><br /><searchLink fieldCode="AR" term="%22Amit+Sevak%22">Amit Sevak</searchLink><br /><searchLink fieldCode="AR" term="%22Teresa+Ober%22">Teresa Ober</searchLink><br /><searchLink fieldCode="AR" term="%22Ikkyu+Choi%22">Ikkyu Choi</searchLink><br /><searchLink fieldCode="AR" term="%22Jesse+Sparks%22">Jesse Sparks</searchLink><br /><searchLink fieldCode="AR" term="%22Daniel+Fishtein%22">Daniel Fishtein</searchLink><br /><searchLink fieldCode="AR" term="%22Educational+Testing+Service+%28ETS%29%22">Educational Testing Service (ETS)</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22ETS+Research+Institute%22"><i>ETS Research Institute</i></searchLink>. 2024.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: ETS Research Institute. Available from: Educational Testing Service. Rosedale Road Mailstop 13E, Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; Web site: https://www.ets.org/research.html
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 72
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Evaluative
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Performance+Based+Assessment%22">Performance Based Assessment</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Criteria%22">Evaluation Criteria</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Bias%22">Test Bias</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Content%22">Test Content</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Reliability%22">Test Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Standards%22">Standards</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Evaluation%22">Student Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Personnel+Evaluation%22">Personnel Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Error+of+Measurement%22">Error of Measurement</searchLink><br /><searchLink fieldCode="DE" term="%22Information+Security%22">Information Security</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Skill+Development%22">Skill Development</searchLink><br /><searchLink fieldCode="DE" term="%22Feedback+%28Response%29%22">Feedback (Response)</searchLink><br /><searchLink fieldCode="DE" term="%22Long+Range+Planning%22">Long Range Planning</searchLink><br /><searchLink fieldCode="DE" term="%22Strategic+Planning%22">Strategic Planning</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Assessment refers to a broad array of approaches for measuring or evaluating a person's (or group of persons') skills, behaviors, dispositions, or other attributes. Assessments range from standardized tests used in admissions, employee selection, licensure examinations, and domestic and international largescale assessments of cognitive and behavioral skills to formative K-12 classroom curricular assessments. The various types of assessments are used for a wide variety of purposes, but they also have many common elements, such as standards for their reliability, validity, and fairness--even classroom assessments have standards (Klinger et al., 2015). The authors believe the future of assessments will involve a shift in emphasis on what skills will be measured, innovations in how one goes about measuring them, the use of advanced technologies for test operations, and an expansion in the value and kinds of information that test-takers will receive from taking the assessment. In this paper, the authors argue and provide evidence for the belief that the future of assessment contains challenges but is promising. The challenges include risks associated with security and exposure of personal data, test score bias, and inappropriate test uses, all of which may be exacerbated by the growing infiltration of artificial intelligence (AI) into people's lives. The promise is increasing opportunities for testing to help individuals achieve their education and career goals and contribute to well-being and overall quality of life. To help achieve this promise the authors focus on the evidence-based science of measurement in education and workplace learning, a theme throughout this paper. The first section of the paper reviews evidence for the value of assessment and discusses how the role of assessment may expand as skills become the new currency. The many purposes of assessment are discussed, from high-stakes examinations and selection tests to low-stakes formative assessments. The emerging challenges to testing and assessment, related to perceptions about their value, their focus, validity, fairness and equity concerns, are reviewed. The authors conclude the first section with a discussion of the prospects for the future of assessments, including the capacity of assessment to provide useful information to test-takers, the importance of identifying key skills and advancing methods for assessing hard-to-measure skills, and the importance of providing opportunities with personalized feedback. The remaining sections of the paper address those themes. The intended audience for this report is broad-ranging from the international scientific community in areas engaged in assessment, particularly education and workforce, to policy-makers and funders in those areas. The authors try to strike a balance between technical detail and accessibility to the broad audience.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: ERIC
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED660962
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED660962
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 72
    Subjects:
      – SubjectFull: Performance Based Assessment
        Type: general
      – SubjectFull: Evaluation Criteria
        Type: general
      – SubjectFull: Evaluation Methods
        Type: general
      – SubjectFull: Test Bias
        Type: general
      – SubjectFull: Test Construction
        Type: general
      – SubjectFull: Test Content
        Type: general
      – SubjectFull: Test Reliability
        Type: general
      – SubjectFull: Test Validity
        Type: general
      – SubjectFull: Standards
        Type: general
      – SubjectFull: Student Evaluation
        Type: general
      – SubjectFull: Personnel Evaluation
        Type: general
      – SubjectFull: Error of Measurement
        Type: general
      – SubjectFull: Information Security
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Skill Development
        Type: general
      – SubjectFull: Feedback (Response)
        Type: general
      – SubjectFull: Long Range Planning
        Type: general
      – SubjectFull: Strategic Planning
        Type: general
    Titles:
      – TitleFull: Charting the Future of Assessments. Full Report
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Educational Testing Service (ETS)
      – PersonEntity:
          Name:
            NameFull: Patrick C. Kyllonen
      – PersonEntity:
          Name:
            NameFull: Amit Sevak
      – PersonEntity:
          Name:
            NameFull: Teresa Ober
      – PersonEntity:
          Name:
            NameFull: Ikkyu Choi
      – PersonEntity:
          Name:
            NameFull: Jesse Sparks
      – PersonEntity:
          Name:
            NameFull: Daniel Fishtein
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 10
              M: 04
              Type: published
              Y: 2024
          Titles:
            – TitleFull: ETS Research Institute
              Type: main
ResultId 1