[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-seo-620900-105":3,"detail-sidebar-cat-0-en-105":81,"doc-detail-620900-en":130},{"code":4,"msg":5,"data":6},0,"ok",{"site_id":7,"language":8,"slug":9,"title":10,"keywords":11,"description":12,"schema_data":13,"social_meta":74,"head_meta":76,"extra_data":78,"updated_unix":80},105,"en","introduction-onscreen-test-equivalency-research-in-the-uk","Introduction - Onscreen Test Equivalency Research in the UK","","The document examines the early development of high-stakes onscreen testing in the United Kingdom and argues that online assessments must address equivalency with traditional paper-and-pencil tests. It reviews regulatory concerns focused on score and construct interchangeability and summarizes debate from U.S. research that manual documentation is required when administration or recording modes differ. It further explains why establishing equivalence is costly for UK awarding bodies and highlights literature findings on test mode effects.",{"@graph":14,"@context":73},[15,34,56],{"@type":16,"itemListElement":17},"BreadcrumbList",[18,23,27,31],{"item":19,"name":20,"@type":21,"position":22},"https://docshare.wps.com","Home","ListItem",1,{"item":24,"name":25,"@type":21,"position":26},"https://docshare.wps.com/document/","Document",2,{"item":28,"name":29,"@type":21,"position":30},"https://docshare.wps.com/document/research-report/","Research & Report",3,{"item":32,"name":10,"@type":21,"position":33},"https://docshare.wps.com/document/introduction-onscreen-test-equivalency-research-in-the-uk/620900/",4,{"url":32,"name":10,"@type":35,"image":36,"author":41,"headline":10,"publisher":44,"fileFormat":47,"inLanguage":8,"description":12,"dateModified":48,"datePublished":49,"encodingFormat":47,"isAccessibleForFree":50,"interactionStatistic":51},"DigitalDocument",{"url":37,"@type":38,"width":39,"height":40},"https://docshare.wps.com/thumbnails/introduction-onscreen-test-equivalency-research-in-the-uk/620900.png","ImageObject",300,407,{"name":42,"@type":43},"Jordan Avery","Person",{"url":19,"name":45,"@type":46},"DocShare","Organization","application/pdf","2026-10-31","2026-10-20",true,{"@type":52,"interactionType":53,"userInteractionCount":55},"InteractionCounter",{"@type":54},"ViewAction",6,{"@type":57,"mainEntity":58},"FAQPage",[59,65,69],{"name":60,"@type":61,"acceptedAnswer":62},"Why does the UK regulator focus on equivalency between onscreen and paper-and-pencil tests?","Question",{"text":63,"@type":64},"Because the emerging UK onscreen tests are online translations of paper-and-pencil assessments, the regulator is concerned that scores and constructs remain interchangeable across modes.","Answer",{"name":66,"@type":61,"acceptedAnswer":67},"What does the AERA guidance imply about comparing test scores across different delivery methods?",{"text":68,"@type":64},"It indicates that when multiple response-recording or administration methods are possible, the manual should document how far scores from these methods are interchangeable, meaning equivalence cannot be assumed without evidence.",{"name":70,"@type":61,"acceptedAnswer":71},"What literature-based conclusion does the document describe regarding test mode effects?",{"text":72,"@type":64},"Early reviews produced mixed results—sometimes higher, sometimes lower, and sometimes no differences—yet the document argues that many interacting variables make it unsafe to generalize without proving comparability or publishing separate norms.","https://schema.org",{"og:url":32,"og:type":75,"og:title":10,"og:site_name":45,"og:description":12},"article",{"robots":77,"canonical":32},"index,follow",{"doc_id":79,"site_id":7},620900,1792988372,{"code":4,"msg":82,"data":83},"success",[84,88,92,96,101,105,110,114,119,122,126],{"id":22,"doc_module":4,"doc_module_name":25,"category_name":85,"show_sort_weight":86,"slug":87},"Story & Novel",90,"story-novel",{"id":26,"doc_module":4,"doc_module_name":25,"category_name":89,"show_sort_weight":90,"slug":91},"Literature",80,"literature",{"id":33,"doc_module":4,"doc_module_name":25,"category_name":93,"show_sort_weight":94,"slug":95},"Exam",70,"exam",{"id":97,"doc_module":4,"doc_module_name":25,"category_name":98,"show_sort_weight":99,"slug":100},5,"Comic",60,"comic",{"id":55,"doc_module":4,"doc_module_name":25,"category_name":102,"show_sort_weight":103,"slug":104},"Technology",50,"technology",{"id":106,"doc_module":4,"doc_module_name":25,"category_name":107,"show_sort_weight":108,"slug":109},7,"Healthcare",40,"healthcare",{"id":111,"doc_module":4,"doc_module_name":25,"category_name":29,"show_sort_weight":112,"slug":113},8,30,"research-report",{"id":115,"doc_module":4,"doc_module_name":25,"category_name":116,"show_sort_weight":117,"slug":118},9,"Religion & Spirituality",20,"religion-spirituality",{"id":117,"doc_module":4,"doc_module_name":25,"category_name":120,"show_sort_weight":117,"slug":121},"World Cup","world-cup",{"id":123,"doc_module":4,"doc_module_name":25,"category_name":124,"show_sort_weight":123,"slug":125},10,"Lifestyle","lifestyle",{"id":127,"doc_module":4,"doc_module_name":25,"category_name":128,"show_sort_weight":97,"slug":129},19,"General","general",{"code":4,"msg":82,"data":131},{"doc_id":79,"user_id":132,"nickname":42,"user_avatar":133,"doc_module":4,"category_id":111,"category_name":29,"doc_title":10,"doc_description":12,"doc_content":134,"file_id":135,"file_url":136,"file_type":137,"file_size":138,"view_count":55,"is_deleted":4,"is_public":22,"is_downloadable":22,"audit_status":22,"page_count":139,"language":140,"language_code":8,"site_id":7,"html_lang":8,"table_of_contents":141,"faqs":142,"seo_title":143,"seo_description":12,"update_tm":144,"read_time":145},1099523882367,"https://ap-avatar.wpscdn.com/davatar_9964176cb1d06d4a9deccf72a44ae3dc","INTRODUCTION  \nHigh-stakes onscreen testing in the United Kingdom is still very much in its infancy, involving automation of assessment tasks rather than their reconceptualisation (Bennett, 1997) . The emerging high-stakes onscreen tests in the UK are online translations of their paper and pencil equivalent, and the regulator of these tests, the Qualification and Curriculum Authority (QCA) is preoccupied with the equivalency between the online translation and its paper and pencil equivalent. While the fact that assessment in the UK appears to be lagging ten years behind the United States may wound national pride (ten years may be an underestimation as Bennett’s description of first generation of tests refers insouciantly to item banks, on-demand testing and instant results services, and the first meta-analysis of onscreen tests appeared in 1988) there should be a competitive advantage to be gained. There should be no need, for example, to repeat the research that has underpinned the first generation of high-stakes tests in the US; this should reduce development and implementation costs. While the assessment  \nsystems of the two countries are fundamentally different in a number of respects, the first generation of onscreen assessments, constrained by limited item formats, brings them closer together than ever before. It would seem wise therefore to carefully consider the research findings on equivalency from the US before proceeding too far with the introduction of a regulatory framework and programme of research for onscreen assessments in the UK.  \nFast forwarding through the research to the regulatory framework currently in operation in the United States does not, however, offer much comfort:  \n“If a test is designed so that more than one method can be used for administration or recording responses—such as marking responses in a test booklet, on a separate answer sheet, or on a computer keyboard— then the manual should clearly document the extent to which scores arising from these methods are interchangeable” (American Educational Research Association, 1999, p. 70) .  \nIt would seem that the American Educational Research Association (AERA) considers that it cannot simply be assumed that the test scores from two administrations using different modes are equivalent. Bugbee (1996) reached this conclusion in his review of the comparability literature, stating that onscreen and paper and pencil tests can be equivalent, but it is the responsibility of the test developer to show that they are. This view has been picked up in the UK, in that it is considered necessary to establish score and construct equivalence if scores of paper and pencil and onscreen tests are to be interchangeable (MacDonald, 2001) . Such a requirement, that equivalence must be actively demonstrated, would sound the death knell for high-stakes onscreen assessment in the UK.  \nHigh-stakes assessment in the UK is undertaken by a number of private organisations of charitable or profit-making status known as Awarding Bodies. Between them they assess a bewildering array of syllabuses ranging from Dance to Physics at a number of different levels, often more than once per year. The assessments are thorough examinations of the syllabuses that have been taught and use assessment methods designed to suit the particular construct under examination. The cost of proving the equivalence of scores for onscreen and paper and pencil versions of such a varied assessment diet could not be borne by the awarding bodies, and would likely result in an end to innovation. UK high-stakes onscreen assessment would never move beyond the first generation.  \nIt seems that the need to actively demonstrate the equivalence of scores is a result of an apparent lack of consensus in the literature on whether test mode effects exist. The first major review of the literature yielded a number of detailed findings, only to conclude there were no generalisations to be drawn (Mazzeo & Harvey, 1988) . T","cbCaijxhPEtGOnke","https://ap.wps.com/l/cbCaijxhPEtGOnke","pdf",587416,13,"English","# Introduction\n## UK high-stakes onscreen testing and regulatory equivalency concerns\n## Interchangeability requirements and evidence from AERA\n## Awarding bodies, costs, and limits on innovation\n## Literature reviews on test mode effects\n## Variables influencing comparability: test takers and test characteristics","[{\"question\":\"Why does the UK regulator focus on equivalency between onscreen and paper-and-pencil tests?\",\"answer\":\"Because the emerging UK onscreen tests are online translations of paper-and-pencil assessments, the regulator is concerned that scores and constructs remain interchangeable across modes.\"},{\"question\":\"What does the AERA guidance imply about comparing test scores across different delivery methods?\",\"answer\":\"It indicates that when multiple response-recording or administration methods are possible, the manual should document how far scores from these methods are interchangeable, meaning equivalence cannot be assumed without evidence.\"},{\"question\":\"What literature-based conclusion does the document describe regarding test mode effects?\",\"answer\":\"Early reviews produced mixed results—sometimes higher, sometimes lower, and sometimes no differences—yet the document argues that many interacting variables make it unsafe to generalize without proving comparability or publishing separate norms.\"}]","Introduction - Onscreen Test Equivalency Research in the UK | PDF",1792464728,33]