MAAD-Feb-2025-Exam-Data - Analytical Work to Support February 2025 Bar Exam Scoring and Remediation

Sep 21, 2026

Analytical work supports February 2025 bar exam scoring accuracy and remediation by examining exam-content capture and disruption indicators. The analysis reviews representative essay and performance test (PT) submissions from a sample of 351 applicants drawn from 4,009 where content was captured for all five essays and the PT. It evaluates missing essays, MCQ submission counts, word-count deviations, timing percentile anomalies, and day-level total testing-time irregularities, alongside staff and applicant disruption signals to estimate disruption prevalence and differences across remote and in-person test takers.

LanguageEnglish

CategoryExam

FormatPDF

Pages30

Reading Time1 h 16 min

AccessFree to download

Overview of Analytical Projects

Analyze Exam Content Purpose

Explore Applicant Self-Reported Exam Experiences Purpose

Indicators of Test Disruption

Reports of Disruption

Project: Analyze Essays/Performance Test Content for 351 Test Takers

Objective

Results

Analytical Work to Support February 2025 Bar Exam Scoring and Remediation Mission Advancement & Accountability Division Based on data available as of April 21, 2025 Overview of Analytical Projects Analyze Exam Content Purpose (1) Review essay/performance test content for a Confirm the gradable content was captured by Meazure Learning platform; representative sample of applicants identify percent of sample that experienced a test disruption using various indicators (2) Identify the number/percent of all test takers who did not Support scoring adjustment and remediation considerations experience at least one test disruption Explore Applicant Self-Reported Exam Experiences Purpose (1) Analyze post-February 2025 bar exam survey Support scoring adjustment and remediation considerations Analyses of Exam Content Indicators of Test Disruption Indicators of Test Disruption Used in Analyses of Exam Content | Type of Measure | Indicator of Test Disruption | Data source | Notes | | --- | --- | --- | --- | | Exam Data | Missing one or more essays, including Performance Test (PT | ML data file that reports time spent on each essay and the PT for each applicant | | | | Fewer than 171 Multiple Choice Questions (MCQ) submitted | MCQ answer file (ACS) | | | | At least one essay is below the expected word-count range. | Individual essay response text provided by Meazure Learning (ML) | Using February 2024 as the benchmark, we flagged any 2025 essay under 2 standard deviations as shorter than normal. | | | Any essay including PT submitted outside the 95th– 100th percentile of the allotted time. | ML data file that reports time spent on each essay and the PT for each applicant | For non-accommodated applicants: essays submitted in less than 55 minutes or more than 60 minutes; PT was submitted less than 80 minutes or more than 90 minutes. | | | Total testing time (either day) outside the normal range | Day-level start/finish file (ML) | | Indicators of Test Disruption Used in Analyses of Exam Content | Type of Measure | Indicator of Test Disruption | Data source | Notes | | --- | --- | --- | --- | | Staff review of essay/PT submissions | At least one essay or the PT was not gradable | Essays/PT submissions | Here staff skimmed content to confirm content was relevant (and not, for example, a paste-in of the essay/PT prompt) | | | At least one essay or the PT was shorter than the rest of their written submissions. | Essays/PT submissions | Staff skimmed across all essays and PT to get a sense if any were significantly shorter. | | | At least one essay or the PT contained a message from the applicant about technical problem faced during the exam. | Essays/PT submissions | In most cases, this was a short message. | | | At least one essay or the PT remained in notes and was not pasted into question submission box | Essays/PT submissions | This is an indicator that the cut and paste function did not work. | | | At least one essay or the PT had a cut-off sentence | Essays/PT submissions | At least one essay or the PT had a cut-off sentence | | | | | | Reports of Disruption ML reported that applicant contacted ML on Day 1 re: technical problem Applicant participated in post-exam survey and reported experiencing a technology, administrative, or proctor issue during the essay or PT portion of the exam ML data file that captured all requests for technical assistance during the exam for remote test takers only. Feb 2025 Post-exam Survey This file was limited to remote test takers only. Applicant contacted State Bar regarding a technology issue experienced during essay/PT portion of exam Messages sent through AIMS portal; emails sent to State Bar Project: Analyze Essays/Performance Test Content for 351 Test Takers Objective According to Meazure Learning (ML), the exam platform successfully captured content for all five essays and the performance test (PT) in either the essay/PT submission

FAQs

What is the purpose of analyzing February 2025 bar exam scoring and remediation data?

To support scoring accuracy and remediation by analyzing whether gradable content was captured and by estimating how many test takers may have experienced disruptions during the essay/PT portion.

Which indicators are used to detect exam-content disruption?

Indicators include missing essays or PT, insufficient MCQ submissions, essays below expected word-count ranges, essay/PT submitted outside the allotted-time percentile range, and total testing time outside the normal day-level range.

How were disruptions identified and validated beyond raw exam timing?

Staff reviewed essay/PT submissions for gradability issues and content anomalies, and applicant experience signals were used from post-exam surveys and contacts with Meazure Learning or the State Bar regarding technical or administrative issues.

Sep 21, 2026

Uploaded by Oliver Hayes