Study Review Protocol and Supplement to the 'What Works Clearinghouse Procedures and Standards Handbook, Version 5.0,' Version 5.1. Updated

Saved in:
Bibliographic Details
Title: Study Review Protocol and Supplement to the 'What Works Clearinghouse Procedures and Standards Handbook, Version 5.0,' Version 5.1. Updated
Language: English
Authors: National Center for Education Evaluation and Regional Assistance (NCEE) (ED/IES), What Works Clearinghouse (WWC)
Source: What Works Clearinghouse. 2025.
Availability: What Works Clearinghouse. 550 12th Street SW, Washington, DC 20024; e-mail: contact.WWC@ed.gov; Web site: https://whatworks.ed.gov/
Peer Reviewed: Y
Page Count: 18
Publication Date: 2025
Document Type: Reports - Descriptive
Education Level: Early Childhood Education
Preschool Education
Elementary Secondary Education
Postsecondary Education
Descriptors: Educational Research, Preschool Education, Elementary Secondary Education, Postsecondary Education, Learning Readiness, Academic Achievement, Graduation, Educational Attainment, Outcomes of Education, Education Work Relationship, Educational Opportunities, Principals, Teachers
Abstract: The What Works Clearinghouse (WWC) Study Review Protocol accompanies the "WWC Procedures and Standards Handbook, Version 5.0" and guides reviews of studies by the WWC. The WWC uses this protocol to review all studies, including those cited as evidence for U.S. Department of Education grant competitions, studies that were funded by the Department, and studies identified for systematic reviews of evidence based on a search of the research literature in a particular topic area. When the Study Review Protocol is used to review studies for systematic reviews, an accompanying topic area synthesis protocol will provide criteria for the literature search; guidance on how to identify and prioritize relevant studies for review and inclusion in evidence synthesis products; and guidance on intervention, sample, and outcome eligibility criteria for the synthesis. This protocol updates the December 2024 "Study Review Protocol, Version 5.1." It describes a pilot process that integrates artificial intelligence (AI) tools, such as large language models, into the WWC review process. This version of the protocol retains clarifications to outcome domains and formalized guidance and clarifications to the "Handbook" provided with the December 2024 "Study Review Protocol, Version 5.1." No other substantive changes have been made. Review teams should use this "Study Review Protocol, Version 5.1," applying either the pilot or the standard review process, for all new reviews conducted under Version 5.0 standards.
Abstractor: ERIC
IES Funded: Yes
IES Publication: https://ies.ed.gov/ncee/WWC/Document/1297
Entry Date: 2026
Accession Number: ED678600
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED678600
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED678600
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Study Review Protocol and Supplement to the 'What Works Clearinghouse Procedures and Standards Handbook, Version 5.0,' Version 5.1. Updated
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22National+Center+for+Education+Evaluation+and+Regional+Assistance+%28NCEE%29+%28ED%2FIES%29%2C+What+Works+Clearinghouse+%28WWC%29%22">National Center for Education Evaluation and Regional Assistance (NCEE) (ED/IES), What Works Clearinghouse (WWC)</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22What+Works+Clearinghouse%22"><i>What Works Clearinghouse</i></searchLink>. 2025.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: What Works Clearinghouse. 550 12th Street SW, Washington, DC 20024; e-mail: contact.WWC@ed.gov; Web site: https://whatworks.ed.gov/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 18
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Descriptive
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Early+Childhood+Education%22">Early Childhood Education</searchLink><br /><searchLink fieldCode="EL" term="%22Preschool+Education%22">Preschool Education</searchLink><br /><searchLink fieldCode="EL" term="%22Elementary+Secondary+Education%22">Elementary Secondary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Educational+Research%22">Educational Research</searchLink><br /><searchLink fieldCode="DE" term="%22Preschool+Education%22">Preschool Education</searchLink><br /><searchLink fieldCode="DE" term="%22Elementary+Secondary+Education%22">Elementary Secondary Education</searchLink><br /><searchLink fieldCode="DE" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Readiness%22">Learning Readiness</searchLink><br /><searchLink fieldCode="DE" term="%22Academic+Achievement%22">Academic Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Graduation%22">Graduation</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Attainment%22">Educational Attainment</searchLink><br /><searchLink fieldCode="DE" term="%22Outcomes+of+Education%22">Outcomes of Education</searchLink><br /><searchLink fieldCode="DE" term="%22Education+Work+Relationship%22">Education Work Relationship</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Opportunities%22">Educational Opportunities</searchLink><br /><searchLink fieldCode="DE" term="%22Principals%22">Principals</searchLink><br /><searchLink fieldCode="DE" term="%22Teachers%22">Teachers</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The What Works Clearinghouse (WWC) Study Review Protocol accompanies the "WWC Procedures and Standards Handbook, Version 5.0" and guides reviews of studies by the WWC. The WWC uses this protocol to review all studies, including those cited as evidence for U.S. Department of Education grant competitions, studies that were funded by the Department, and studies identified for systematic reviews of evidence based on a search of the research literature in a particular topic area. When the Study Review Protocol is used to review studies for systematic reviews, an accompanying topic area synthesis protocol will provide criteria for the literature search; guidance on how to identify and prioritize relevant studies for review and inclusion in evidence synthesis products; and guidance on intervention, sample, and outcome eligibility criteria for the synthesis. This protocol updates the December 2024 "Study Review Protocol, Version 5.1." It describes a pilot process that integrates artificial intelligence (AI) tools, such as large language models, into the WWC review process. This version of the protocol retains clarifications to outcome domains and formalized guidance and clarifications to the "Handbook" provided with the December 2024 "Study Review Protocol, Version 5.1." No other substantive changes have been made. Review teams should use this "Study Review Protocol, Version 5.1," applying either the pilot or the standard review process, for all new reviews conducted under Version 5.0 standards.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: ERIC
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: CodeSource
  Label: IES Publication
  Group: SrcInfo
  Data: <link linkTarget="URL" linkTerm="https://ies.ed.gov/ncee/WWC/Document/1297" linkWindow="_blank">https://ies.ed.gov/ncee/WWC/Document/1297</link>
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2026
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED678600
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED678600
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 18
    Subjects:
      – SubjectFull: Educational Research
        Type: general
      – SubjectFull: Preschool Education
        Type: general
      – SubjectFull: Elementary Secondary Education
        Type: general
      – SubjectFull: Postsecondary Education
        Type: general
      – SubjectFull: Learning Readiness
        Type: general
      – SubjectFull: Academic Achievement
        Type: general
      – SubjectFull: Graduation
        Type: general
      – SubjectFull: Educational Attainment
        Type: general
      – SubjectFull: Outcomes of Education
        Type: general
      – SubjectFull: Education Work Relationship
        Type: general
      – SubjectFull: Educational Opportunities
        Type: general
      – SubjectFull: Principals
        Type: general
      – SubjectFull: Teachers
        Type: general
    Titles:
      – TitleFull: Study Review Protocol and Supplement to the 'What Works Clearinghouse Procedures and Standards Handbook, Version 5.0,' Version 5.1. Updated
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: National Center for Education Evaluation and Regional Assistance (NCEE) (ED/IES), What Works Clearinghouse (WWC)
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 11
              Type: published
              Y: 2025
          Titles:
            – TitleFull: What Works Clearinghouse
              Type: main
ResultId 1