Issues of Candidate Perception in a Performance Test for Lawyers

Aug 30, 2026

A performance test for bar admissions was developed and evaluated with candidate perceptions as a key source of information. A candidate-perception questionnaire was administered to participants in a pilot study, collecting demographic and historical details alongside opinions about the test. Responses from the 3-hour version were compared with responses from the 90-minute version, with samples of roughly 400 and 1,280. Findings show broad acceptance of face validity, while both groups reported insufficient time to complete performance tasks.

LanguageEnglish

CategoryExam

FormatPDF

Pages37

Reading Time1 h 33 min

AccessFree to download

Overview

Methodology

ED 373096 AUTHOR TITLE PUB DATE NOTE PUB TYPE EDRS PRICE DESCRIPTORS IDENTIFIERS ABSTRACT DOCUMENT RESUME Kunce,Charles S.;Arbet,Scott E. # Issues of Candidate Perception in a Performance Testfor Lawyers. Apr 94 37p.;Paper presented at the Annual Meeting of theNational Council on Measurement in Education(NewOrleans,LA,April 5-7,1994).Reports -Research/Technical(143)--Speeches/Conference Papers(150) MF01/PC02 Plus Postage. *Attitudes;Demography;*Languages;*Lawyers;*Licensing Examinations(Professions);PilotProjects;Questionnaires;*Test Construction;TestFormat;Test Length;Test Validity *Bar Examinations;National Conference of BarExaminers;*Performance Based Evaluation The National Conference of Bar Examiners commissionedAmerican College Testing,Inc.,to help them in the development andevaluation of a performance test for use in bar admissions decisions.Because it was recognized that candidate perceptions would providevaluable information,a candidate-perception questionnaire wasdeveloped to be administered to candidates in the pilot study of theperformance test.Demographic and historical information wasrequested,as well as information about candidates'perceptions ofthe test.In this study,perceptions of candidates who took the3-hour test version were compared with those of candidates who tookthe 90-minute version,The number of candidates completing questionnaire items varied,but the sample was approximately 400 forthe 3-hour test and 1,280 for the 90-minute test.Candidates'perceptions about the tests varied widely,but two conclusions areunmistakable:Candidates on the whole accept the face validity of theperformanca test,and candidates taking either test,regardless oflength,felt that they did not have enough time to complete theperformance tasks.Eighteen graphs present study findings.(SLD) *****☆******☆**☆***********☆☆***☆**☆*****☆☆☆*☆*☆☆☆☆*☆*☆**☆**☆☆***☆****Reproductions supplied by EDRS are the best that can be made 六 ☆from the original document. | U.8.DEPAWTMEH7 OF EDUCATIOM
"PERMISSION TO REPRODUCE THIS
OMce ot Educatona!Ra56a1ch and improvemenl
MATERIAL HAS BEEN GRANTED BY
EDUCATIONALRESOURCES INFOAMATION
CENTER(ERIC)
this document haa been leproducou
18CBrved trom the person or organizatron
originating it
口Minor chan0he b0mad to imYow
roproduction quality
Ponls of wor oDn100fatdinfh dc
ment do nof nC0s rly taDromot oftic,l
TO THE EDUCATIONAL RESOURCES
OERI positon or polc
INFORMATICN CENTER (ERICL'
ED 373 069
Issues of Candidate Perception
in a
Performance Test for Lawyers
Charles S.Kunce
Scott E.Arbet
American College Testing
April 1994
Paper presented at the annual meeting of the National Council on
Measurement in Education,New Orleans,in Symposium P3,Performance
Assessment:Evaluating Competing Perspectives on Use for High Stakes
Testing.
BEST COPY AVAILABLE
ScoTT E.ARBET
CHfARLEs S. KunCE | | --- | 286 2 ## Overview The National Conference of Bar Examiners(NCBE)commisioned ACT to assist themin the development and evaluation of a performance test(PT)for use in Baradmissions decisions.Early in the planning of the PT,the NCBE and ACTrecognized that candidate perceptions could provide valuable information in thedevelopment of the program.Therefore it was determined that a questionnaire wouldbe administered to ea h candidate in the pilot study immediately upon completion ofthe PT.The questionnaires were developed by ACT in consultation with NCBE,andwere administered by each jurisdiction's administrative staff.ACT tabulated andanalyzed the data. The items in the questionnaire were designed to gather meaningful demographic andhistorical information about each candidate plus specific opinions about variousaspects of the PT.It was hoped that the analysis would provide useful informationfor improving the examinations,as well as

FAQs

What was the purpose of the candidate-perception questionnaire in this performance test study?

The questionnaire was used to gather candidates’ demographic and historical information plus their opinions about aspects of the performance test during the pilot study.

How did perceptions differ between the 3-hour and 90-minute test versions?

Candidates in both conditions reported they did not have enough time to complete the performance tasks, and perceptions varied widely in other respects.

What were the study’s main conclusions about the test’s acceptability and timing?

Candidates generally accepted the performance test’s face validity, but both groups felt the allotted time was insufficient for completing the performance tasks.

Aug 30, 2026

Uploaded by Felix Montgomery