Literacy Design Collaborative 2017-2018 Evaluation Report - Evaluation Report

Oct 15, 2026

Evaluation report for the Literacy Design Collaborative’s 2017–2018 implementation, summarizing findings, methods, and analyses across multiple stakeholder surveys and data sources. The document presents study methodology, including data and instruments, sample selection, recruitment and administration, and module rating procedures. It analyzes teacher, teacher leader, and administrator survey results, open-ended responses, and LDC CoreTools participation and engagement metrics, then evaluates module artifacts. Additional sections assess fidelity of implementation and report student outcome analyses using matched analytic samples.

LanguageEnglish

CategoryResearch & Report

FormatPDF

Pages194

Reading Time8 h 9 min

AccessFree to download

Executive Summary

1.0 Introduction

1.1 Logic Model

1.2 Evaluation Questions

2.0 Study Methodology

2.1 Data and Instruments

2.2 Sample

2.3 Survey Recruitment and Administration

2.4 Module Rating Process

2.5 Analytical Approaches

3.0 Survey Analysis

3.1 Teacher Survey Results

3.2 Teacher Leader Survey Results

3.3 Administrator Survey Results

3.4 Open-Ended Responses for All Participants

3.5 Summary of Results

4.0 Analyses of LDC CoreTools Data

4.1 CoreTools Activity Participation Rates

4.2 Engagement With Key CoreTools Activities

4.3 CoreTools Engagement as an Implementation Variable

4.4 Summary of Results

5.0 Module Artifact Analysis

5.1 Analysis of Elementary Modules

5.2 Analysis of Secondary Modules

5.3 Exploratory Analysis of Modules

5.4 Qualitative Results

5.5 Summary of Results

6.0 Fidelity of Implementation Analysis

6.1 School-and Program-Level Fidelity of Implementation Scores

6.2 Key Component 1

6.3 Key Component 2

6.4 Key Component 3

6.5 Key Component 4

6.6 Summary of Results

7.0 Student Outcome Analysis

7.1 LDC Sample and the Matching Process

7.2 Descriptive Results on the Matched Analytic Samples

7.3 Outcome Analysis Results: Cohort 1 Middle School Sample

LITERACY DESIGN COLLABORATIVE 2017–2018 EVALUATION REPORT Jia Wang, Joan L. Herman, Scott Epstein, Seth Leon, Deborah La Torre, Sandy Chang, Velette Bozeman, and Julie Haubner Copyright © 2019 The Regents of the University of California. The work reported herein was supported by grant number 20145515 from the Literacy Design Collaborative with funding to the National Center for Research on Evaluation, Standards, and Student Testing (CRESST) . The findings and opinions expressed in this report are those of the authors and do not necessarily reflect the positions or policies of the Literacy Design Collaborative. To cite from this report, please use the following as your APA reference: Wang, J., Herman, J. L., Epstein, S., Leon, S., La Torre, D., Chang, S.,… Haubner, J. (2019) . Literacy Design Collaborative 2017–2018 evaluation report (CRESST Report 863) . Los Angeles: University of California, Los Angeles, National Center for Research on Evaluation, Standards, and Student Testing (CRESST) . Table of Contents Executive Summary .................................................................................................................v 1.0 Introduction ...................................................................................................................... 1 1.1 Logic Model ............................................................................................................................2 1.2 Evaluation Questions .............................................................................................................4 2.0 Study Methodology........................................................................................................... 6 2.1 Data and Instruments ............................................................................................................6 2.2 Sample....................................................................................................................................9 2.3 Survey Recruitment and Administration ............................................................................ 12 2.4 Module Rating Process ....................................................................................................... 12 2.5 Analytical Approaches ........................................................................................................ 13 3.0 Survey Analysis ............................................................................................................... 19 3.1 Teacher Survey Results ....................................................................................................... 19 3.2 Teacher Leader Survey Results ........................................................................................... 32 3.3 Administrator Survey Results ............................................................................................. 37 3.4 Open-Ended Responses for All Participants ....................................................................... 40 3.5 Summary of Results ............................................................................................................ 43 4.0 Analyses of LDC CoreTools Data ...................................................................................... 46 4.1 CoreTools Activity Participation Rates................................................................................ 46 4.2 Engagement With Key CoreTools Activities........................................................................ 47 4.3 CoreTools Engagement as an Implementation Variable .................................................... 51 4.4 Summary of Results ............................................................................................................ 51 5.0 Module Artifact Analysis ................................................................................................. 53 5.1 Analysis of Elementary Modules......

FAQs

What is the purpose of this Literacy Design Collaborative evaluation report?

It reports findings from the Literacy Design Collaborative’s 2017–2018 efforts by compiling results from surveys, CoreTools usage data, module artifact analyses, fidelity of implementation, and student outcome analyses.

What kinds of data and measures does the report analyze?

The report covers survey data from teachers, teacher leaders, and administrators; open-ended responses; CoreTools activity participation and engagement; module artifact analyses; fidelity of implementation scores; and student outcomes using matched analytic samples.

How does the report evaluate fidelity of implementation?

It analyzes fidelity at school- and program-level and examines key implementation components, including planning time with synchronous coach support, asynchronous support from coaches, teacher implementation activities, and leadership support at different levels.

Oct 15, 2026

Uploaded by Alex Sinclair