WHAT WORKS CLEARINGHOUSE - Study Review Protocol and Supplement to the WWC Procedures and Standards Handbook, Version 5.0 - Version 5.1 (November 2025)

Oct 15, 2026

Uploaded by Bintang

Study Review Protocol and Supplement defines how the What Works Clearinghouse (WWC) reviews studies under the Procedures and Standards Handbook, Version 5.0, and updates that process for Version 5.1 (November 2025). It explains eligible study reviews, including those used for U.S. Department of Education grant competitions and systematic reviews, and describes a pilot approach integrating artificial intelligence tools such as large language models. It specifies eligible outcome domains, guidance on eligibility criteria, and rules governing re-review across protocol versions while clarifying outcome domains and formalized handbook guidance.

LanguageEnglish

CategoryResearch & Report

FormatPDF

Pages18

Reading Time45 min

AccessFree to download

ELIGIBLE OUTCOME DOMAINS

Academic Readiness, Knowledge, or Skills (Preschool through Postsecondary)

General Achievement

Language Arts

Mathematics

Science

Other

Preschool through Grade 12 Progress and Completion

Postsecondary Progress and Success

Workforce Outcomes

Social, Emotional, Behavioral, and Mental Health Outcomes (Preschool through Postsecondary)

School and Family Outcomes and Educational Opportunity (Preschool through Postsecondary)

School Leader Outcomes

Teacher Outcomes

Other

MAIN VERSUS SUPPLEMENTAL FINDINGS

BASELINE EQUIVALENCE

WHAT WORKS CLEARINGHOUSETM Study Review Protocol and Supplement to the What Works Clearinghouse Procedures and Standards Handbook, Version 5.0 Version 5.1 (November 2025) A Publication of the National Center for Education Evaluation atIES The What Works Clearinghouse (WWC) Study Review Protocol accompanies the WWC Procedures and Standards Handbook, Version 5.0 and guides reviews of studies by the WWC. The WWC uses this protocol to review all studies, including those cited as evidence for U.S. Department of Education grant competitions, studies that were funded by the Department, and studies identified for systematic reviews of evidence based on a search of the research literature in a particular topic area. When the Study Review Protocol is used to review studies for systematic reviews, an accompanying topic area synthesis protocol will provide criteria for the literature search; guidance on how to identify and prioritize relevant studies for review and inclusion in evidence synthesis products; and guidance on intervention, sample, and outcome eligibility criteria for the synthesis (see page 10 in the Handbook) . This protocol updates the December 2024 Study Review Protocol, Version 5.1 . It describes a pilot process that integrates artificial intelligence (AI) tools, such as large language models, into the WWC review process. This version of the protocol retains clarifications to outcome domains and formalized guidance and clarifications to the Handbook provided with the December 2024 Study Review Protocol, Version 5.1 . No other substantive changes have been made. Review teams should use this Study Review Protocol, Version 5.1, applying either the pilot or the standard review process, for all new reviews conducted under Version 5.0 standards. Contents ELIGIBLE OUTCOME DOMAINS......................2 Academic Readiness, Knowledge, or Skills (Preschool through Postsecondary) ............ 3 General Achievement .............................. 3 Language Arts ......................................... 4 Mathematics ........................................... 5 Science ................................................... 6 Other ...................................................... 6 Preschool through Grade 12 Progress and Completion ............................................... 7 Postsecondary Progress and Success .......... 7 Workforce Outcomes ................................. 8 Social, Emotional, Behavioral, and Mental Health Outcomes (Preschool through Postsecondary) .......................................... 9 School and Family Outcomes and Educational Opportunity (Preschool through Postsecondary) .........................................10 School Leader Outcomes .......................... 12 Teacher Outcomes .................................... 12 Other ....................................................... 13 MAIN VERSUS SUPPLEMENTAL FINDINGS ... 13 BASELINE EQUIVALENCE ............................ 16 OTHER .........................................................17 WWC products may synthesize findings from studies reviewed under the Version 5.0 and Version 5.1 Study Review Protocols if the outcome domains are substantively the same across the versions. Acrosswalk of outcome domains can be found on the WWC website. Studies that were previously reviewed under Study Review Protocol, Version 5.0 should not be re-reviewed under the Study Review Protocol, Version 5.1 unless there is a specific justification made by review team leadership and approved by IES. Ifa study was previously reviewed under the Version 4.1 (Study Review Protocol, Version 1.0 or Version 4.1) or Version 5.0 standards and needs to be reviewed under the Study Review Protocol, Version 5.1, a simplified review process can occur where only one reviewer and one reconciler review the study. The Handbook specifies the eligibility criteria for studies of educational interventions to be reviewed by the WWC. The c

FAQs

WWC如何使用该Study Review Protocol来审核研究？

WWC使用该协议来审查所有纳入其流程的研究，包括用于美国教育部资助竞争的证据研究，以及通过系统检索得到、用于证据综合的研究。

Version 5.1相较于2024年12月版本主要更新了什么？

Version 5.1更新了用于试点流程的内容，将人工智能工具（如大语言模型）整合进WWC的审查流程，并保留对结果领域的澄清和对手册中既有指导的正式化说明；未进行其他实质性改动。

哪些结果领域被认为是WWC可审查的Eligible Outcome Domains？

协议列出了按主题类别组织、且在类别内按字母顺序排列的Eligible Outcome Domains，涵盖学前到高等教育的学业准备/知识/技能、通用成就、语言艺术、数学、科学以及其他类别，并进一步覆盖进展与完成、成功与进阶、劳动力结果、社会情感与心理健康、学校与家庭结果、学校领导与教师结果等。

Oct 15, 2026

Uploaded by Bintang