Technical Report - September 2024 CHRL ELE - Executive Summary - Analysis - Scoring

Sep 21, 2026

Technical Report: September 2024 CHRL ELE documents the full examination workflow from administration and form setting through the testing window, followed by analysis procedures. It details data cleaning and integrity checks, post-examination survey design and results, and the initial and key validation processes. The report explains establishing the pass mark through equating, presents scoring outcomes and key examination metrics, and summarizes related development activities including item writing and committee validation. Appendices include the blueprint and supporting tables.

LanguageEnglish

CategoryResearch & Report

FormatPDF

Pages36

Reading Time1 h 31 min

AccessFree to download

Executive Summary

Administration

Form Setting

Testing Window

Analysis

Data Cleaning and Integrity Checks

Post-Examination Survey

Initial Analysis

Key Validation

Establishing the Pass Mark: Equating

Scoring

Key Examination Metrics

Related Development Activities

Item Writing

Validation

Appendix

Blueprint

Technical Report: September 2024 CHRL ELE October 28, 2024 Contents Executive Summary ................................................................................................................. 5 Administration.......................................................................................................................... 6 Form Setting ........................................................................................................................... 6 Testing Window ...................................................................................................................... 7 Analysis .................................................................................................................................... 9 Data Cleaning and Integrity Checks ........................................................................................ 9 Post-Examination Survey .......................................................................................................11 Initial Analysis ........................................................................................................................14 Key Validation ........................................................................................................................16 Establishing the Pass Mark: Equating ....................................................................................19 Scoring ..................................................................................................................................25 Key Examination Metrics........................................................................................................27 Related Development Activities .............................................................................................28 Item Writing ...........................................................................................................................28 Validation ...............................................................................................................................29 Validation 2 ............................................................................................................................30 Appendix .................................................................................................................................33 Blueprint ................................................................................................................................33 List of Tables Table 1: Domain fit at administration .......................................................................................... 7 Table 2: Cognitive level fit at administration ............................................................................... 7 Table 3: Content-related post-examination survey questions* ...................................................11 Table 4: Administration-related post-examination survey questions* .........................................12 Table 5: Testing location preference .........................................................................................12 Table 6: Actual testing location .................................................................................................12 Table 7: Testing location preference by actual testing location..................................................13 Table 8: Reason for choosing own location (live remove proctoring candidates) .......................13 Table 9: Evaluation of testing experience (live remove proctoring candidates) ..........................13 Table 10: Value in future candidates being able to test from their own location (live remote proctoring candidates) ...............................................................................................................13 Table 11 : Able to write at a convenient location (test centre candidates) ........................

FAQs

What stages are covered from administration to final scoring?

The report covers administration (including form setting and the testing window), then moves into analysis with data cleaning, integrity checks, surveys, and validation, culminating in establishing the pass mark via equating and producing scoring and key metrics.

How is the pass mark determined in this report?

The pass mark is established through equating, with explicit equating parameter and outcome tables shown for relevant time periods and combined results.

What related development activities support the examination results?

Related development activities include item writing and validation steps, supported by committee validation references and blueprint-based checks such as domain, cognitive level, and item type fit.

Sep 21, 2026

Uploaded by Clementine