[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-seo-300706-105":3,"detail-sidebar-cat-0-en-105":81,"doc-detail-300706-en":131},{"code":4,"msg":5,"data":6},0,"ok",{"site_id":7,"language":8,"slug":9,"title":10,"keywords":11,"description":12,"schema_data":13,"social_meta":74,"head_meta":76,"extra_data":78,"updated_unix":80},105,"en","the-state-bar-of-california-open-session-agenda-item-committee-of-bar-examiners-item-o-200-april-2020","The State Bar of California - OPEN SESSION - AGENDA ITEM - COMMITTEE OF BAR EXAMINERS ITEM O-200 - APRIL 2020","","Approval and action request for a report prepared by the Committee of Bar Examiners’ psychometrician, addressing implementation of the Appendix I recommendation to evaluate grading for the California Bar Examination. The background outlines governance review work and a staff-directed evaluation of CBX grading processes to identify efficiencies and best practices. The agenda item summarizes the exam structure, training and roles of graders and the EDG team, and explains scaling methods converting written scores and MBE results into a unified proficiency-based scoring framework.",{"@graph":14,"@context":73},[15,34,56],{"@type":16,"itemListElement":17},"BreadcrumbList",[18,23,27,31],{"item":19,"name":20,"@type":21,"position":22},"https://docshare.wps.com","Home","ListItem",1,{"item":24,"name":25,"@type":21,"position":26},"https://docshare.wps.com/document/","Document",2,{"item":28,"name":29,"@type":21,"position":30},"https://docshare.wps.com/document/research-report/","Research & Report",3,{"item":32,"name":10,"@type":21,"position":33},"https://docshare.wps.com/document/the-state-bar-of-california-open-session-agenda-item-committee-of-bar-examiners-item-o-200-april-2020/300706/",4,{"url":32,"name":10,"@type":35,"image":36,"author":41,"headline":10,"publisher":44,"fileFormat":47,"inLanguage":8,"description":12,"dateModified":48,"datePublished":49,"encodingFormat":47,"isAccessibleForFree":50,"interactionStatistic":51},"DigitalDocument",{"url":37,"@type":38,"width":39,"height":40},"https://docshare.wps.com/thumbnails/the-state-bar-of-california-open-session-agenda-item-committee-of-bar-examiners-item-o-200-april-2020/300706.png","ImageObject",300,407,{"name":42,"@type":43},"Mimi","Person",{"url":19,"name":45,"@type":46},"DocShare","Organization","application/pdf","2026-11-04","2026-09-19",true,{"@type":52,"interactionType":53,"userInteractionCount":55},"InteractionCounter",{"@type":54},"ViewAction",13,{"@type":57,"mainEntity":58},"FAQPage",[59,65,69],{"name":60,"@type":61,"acceptedAnswer":62},"What is the purpose of this agenda item O-200?","Question",{"text":63,"@type":64},"It requests approval and action on a report prepared by the Committee’s psychometrician as part of implementing Appendix I’s recommendation to evaluate the grading process for the California Bar Examination.","Answer",{"name":66,"@type":61,"acceptedAnswer":67},"How is the California Bar Examination structured for general and attorney applicants?",{"text":68,"@type":64},"The CBX includes the 2-day General Bar Examination (GBX) and the 1-day Attorneys’ Examination (AX). The AX uses the five essay questions and one Performance Test from the GBX, and attorney applicants are not required to take the MBE.",{"name":70,"@type":61,"acceptedAnswer":71},"How does scaling affect scoring on the California Bar Examination?",{"text":72,"@type":64},"Scaling converts written-section results and MBE raw scores to the same measurement framework so that proficiency levels are comparable across different administrations. The final total relies on equal weighting of written and MBE contributions.","https://schema.org",{"og:url":32,"og:type":75,"og:title":10,"og:site_name":45,"og:description":12},"article",{"robots":77,"canonical":32},"index,follow",{"doc_id":79,"site_id":7},300706,1790176796,{"code":4,"msg":82,"data":83},"success",[84,88,92,96,101,106,111,115,120,123,127],{"id":22,"doc_module":4,"doc_module_name":25,"category_name":85,"show_sort_weight":86,"slug":87},"Story & Novel",90,"story-novel",{"id":26,"doc_module":4,"doc_module_name":25,"category_name":89,"show_sort_weight":90,"slug":91},"Literature",80,"literature",{"id":33,"doc_module":4,"doc_module_name":25,"category_name":93,"show_sort_weight":94,"slug":95},"Exam",70,"exam",{"id":97,"doc_module":4,"doc_module_name":25,"category_name":98,"show_sort_weight":99,"slug":100},5,"Comic",60,"comic",{"id":102,"doc_module":4,"doc_module_name":25,"category_name":103,"show_sort_weight":104,"slug":105},6,"Technology",50,"technology",{"id":107,"doc_module":4,"doc_module_name":25,"category_name":108,"show_sort_weight":109,"slug":110},7,"Healthcare",40,"healthcare",{"id":112,"doc_module":4,"doc_module_name":25,"category_name":29,"show_sort_weight":113,"slug":114},8,30,"research-report",{"id":116,"doc_module":4,"doc_module_name":25,"category_name":117,"show_sort_weight":118,"slug":119},9,"Religion & Spirituality",20,"religion-spirituality",{"id":118,"doc_module":4,"doc_module_name":25,"category_name":121,"show_sort_weight":118,"slug":122},"World Cup","world-cup",{"id":124,"doc_module":4,"doc_module_name":25,"category_name":125,"show_sort_weight":124,"slug":126},10,"Lifestyle","lifestyle",{"id":128,"doc_module":4,"doc_module_name":25,"category_name":129,"show_sort_weight":97,"slug":130},19,"General","general",{"code":4,"msg":82,"data":132},{"doc_id":79,"user_id":133,"nickname":42,"user_avatar":134,"doc_module":4,"category_id":112,"category_name":29,"doc_title":10,"doc_description":12,"doc_content":135,"file_id":136,"file_url":137,"file_type":138,"file_size":139,"view_count":55,"is_deleted":4,"is_public":22,"is_downloadable":22,"audit_status":22,"page_count":140,"language":141,"language_code":8,"site_id":7,"html_lang":8,"table_of_contents":142,"faqs":143,"seo_title":144,"seo_description":12,"update_tm":145,"read_time":146,"preview_page_count":4},2336477974920,"https://ap-avatar.wpscdn.com/davatar_155a257f0dc6eb9ab79c44ca47cae57d","The State Bar  \nof California  \nOPEN SESSION  \nAGENDA ITEM  \nAPRIL 2020  \nCOMMITTEE OF BAR EXAMINERS ITEM O‐200  \nDATE: April 24, 2020  \nTO: Members, Committee of Bar Examiners  \nFROM: Lisa J. Cummins, Program Manager III, Examinations  \nChristina Doell, Program Manager I, Examination Grading  \nSUBJECT: Approval of and Action on Report Prepared by the Committee’s Psychometrician, as Part of the Implementation of the Appendix I Recommendation to Evaluate the Grading Process for the California Bar Examination  \nBACKGROUND  \nThe work of the State Bar’s 2017 Governance in the Public Interest Task Force included a review of the State Bar’s various volunteer sub‐entities, one of which is the Committee of Bar Examiners (Committee), “to assess whether the structure of the sub‐entities aligns with assigned tasks and appropriate oversight mechanism are in place.” The Task Force’s report provided background on the Committee and recommendations for further study. Consultants engaged by the State Bar recommended that the Committee conduct a “review and evaluation of its grading process.”  \nIn response, the Board directed staff to conduct an evaluation of the grading process for the California Bar Exam. Staff consulted with the Committee’s psychometrician, Roger Bolus, Ph. D., and requested him to conduct an evaluation of the processes for grading of the California Bar Examination (CBX), with an emphasis on identifying efficiencies and best practices, and to prepare a report on his findings.  \nAttached is Dr. Bolus’s report, “A Report on the Phased Grading of the California Bar Examination: A Profile of Recent Results and Modeling the Impact of Alternative Approaches,”dated April 9, 2020. Dr. Bolus will also be presenting his report at the Committee’s April 2020 meeting.  \nA.  California Bar Examination  \nThe California Bar Examination (CBX) is made up of the 2‐day General Bar Examination (GBX) and the 1‐day Attorneys’ Examination (AX) . The GBX consists of two sections: the written section including five essay questions and one Performance Test (PT), and the 200‐item Multistate Bar Examination (MBE) . The six written questions are developed in‐house by the State Bar of California and the MBE is developed and owned by the National Conference of Bar Examiners (NCBE) . The AX consists of the five essay questions and one PT from the General Bar Examination only. Attorneys who are eligible to take the AX are not required to take the MBE.  \nTo pass the examination an applicant must have a total scaled score of at least 1440 points out of a possible 2000 points.  \nB.  Graders and EDG Team  \nThe State Bar maintains a pool of approximately 150 graders who are all active California attorneys. Each grading cycle, 12 graders are hired for each of the 6 grading teams (one team per written question on the bar exam), for a total of 72 graders. In addition, 3‐4 backup and apprentice graders are hired. Backup graders are generally ones who have participated in at least one prior grading cycle either as a grader or as an apprentice. Apprentice graders have never graded before. While the backup and apprentice graders are required to do the pre‐ grading assignments and to attend all three grading calibration meetings, they are not called upon to actually grade unless one or more of the primary graders drops out.  \nAfter the administration of the exam, but prior to beginning the grading process, the graders go through a 3‐week training and calibration process to ensure that the grading guidelines are being consistently and appropriately applied. Graders are assigned a variety of tasks including writing a detailed analysis to the question they are assigned, participating in multiple calibration meetings to ensure all answers are graded according to the same standards, and participating in “tentative” grading to determine the level of each group’s calibration.  \nThe six members of the Examination Development and Grading (EDG) Team have many years of prior experi","cbCaicwR1VfMLf8O","https://ap.wps.com/l/cbCaicwR1VfMLf8O","pdf",708640,53,"English","# Background\n## California Bar Examination\n## Graders and EDG Team\n## Scaling","[{\"question\":\"What is the purpose of this agenda item O-200?\",\"answer\":\"It requests approval and action on a report prepared by the Committee’s psychometrician as part of implementing Appendix I’s recommendation to evaluate the grading process for the California Bar Examination.\"},{\"question\":\"How is the California Bar Examination structured for general and attorney applicants?\",\"answer\":\"The CBX includes the 2-day General Bar Examination (GBX) and the 1-day Attorneys’ Examination (AX). The AX uses the five essay questions and one Performance Test from the GBX, and attorney applicants are not required to take the MBE.\"},{\"question\":\"How does scaling affect scoring on the California Bar Examination?\",\"answer\":\"Scaling converts written-section results and MBE raw scores to the same measurement framework so that proficiency levels are comparable across different administrations. The final total relies on equal weighting of written and MBE contributions.\"}]","The State Bar of California - OPEN SESSION - AGENDA ITEM - COMMITTEE OF BAR EXAMINERS ITEM O-200 - APRIL 2020 | PDF",1789776641,134]