[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"detail-sidebar-cat-0-en-105":3,"doc-seo-580747-105":59,"doc-detail-580747-en":130},{"code":4,"msg":5,"data":6},0,"success",[7,13,18,23,28,33,38,43,48,51,55],{"id":8,"doc_module":4,"doc_module_name":9,"category_name":10,"show_sort_weight":11,"slug":12},1,"Document","Story & Novel",90,"story-novel",{"id":14,"doc_module":4,"doc_module_name":9,"category_name":15,"show_sort_weight":16,"slug":17},2,"Literature",80,"literature",{"id":19,"doc_module":4,"doc_module_name":9,"category_name":20,"show_sort_weight":21,"slug":22},4,"Exam",70,"exam",{"id":24,"doc_module":4,"doc_module_name":9,"category_name":25,"show_sort_weight":26,"slug":27},5,"Comic",60,"comic",{"id":29,"doc_module":4,"doc_module_name":9,"category_name":30,"show_sort_weight":31,"slug":32},6,"Technology",50,"technology",{"id":34,"doc_module":4,"doc_module_name":9,"category_name":35,"show_sort_weight":36,"slug":37},7,"Healthcare",40,"healthcare",{"id":39,"doc_module":4,"doc_module_name":9,"category_name":40,"show_sort_weight":41,"slug":42},8,"Research & Report",30,"research-report",{"id":44,"doc_module":4,"doc_module_name":9,"category_name":45,"show_sort_weight":46,"slug":47},9,"Religion & Spirituality",20,"religion-spirituality",{"id":46,"doc_module":4,"doc_module_name":9,"category_name":49,"show_sort_weight":46,"slug":50},"World Cup","world-cup",{"id":52,"doc_module":4,"doc_module_name":9,"category_name":53,"show_sort_weight":52,"slug":54},10,"Lifestyle","lifestyle",{"id":56,"doc_module":4,"doc_module_name":9,"category_name":57,"show_sort_weight":24,"slug":58},19,"General","general",{"code":4,"msg":60,"data":61},"ok",{"site_id":62,"language":63,"slug":64,"title":65,"keywords":66,"description":67,"schema_data":68,"social_meta":123,"head_meta":125,"extra_data":127,"updated_unix":129},105,"en","research-matters-issue-39-learners-annotations-and-written-markings-when-taking-a-digital-multiple-choice-test","Research Matters - Issue 39 - Learners’ annotations and written markings when taking a digital multiple-choice test","","This research enhances understanding of exam techniques and the written annotations or markings learners use to support thinking during digital multiple-choice tests. It examines how factors influence learners to write less rough work and mark less on scrap paper in digital formats compared with paper-based exams. Fifty-two learners completed a digital economics test with access to either scrap paper or a printed test, then questionnaires were completed, with most learners interviewed.",{"@graph":69,"@context":122},[70,84,105],{"@type":71,"itemListElement":72},"BreadcrumbList",[73,77,79,82],{"item":74,"name":75,"@type":76,"position":8},"https://docshare.wps.com","Home","ListItem",{"item":78,"name":9,"@type":76,"position":14},"https://docshare.wps.com/document/",{"item":80,"name":40,"@type":76,"position":81},"https://docshare.wps.com/document/research-report/",3,{"item":83,"name":65,"@type":76,"position":19},"https://docshare.wps.com/document/research-matters-issue-39-learners-annotations-and-written-markings-when-taking-a-digital-multiple-choice-test/580747/",{"url":83,"name":65,"@type":85,"image":86,"author":91,"headline":65,"publisher":94,"fileFormat":97,"inLanguage":63,"description":67,"dateModified":98,"datePublished":99,"encodingFormat":97,"isAccessibleForFree":100,"interactionStatistic":101},"DigitalDocument",{"url":87,"@type":88,"width":89,"height":90},"https://docshare.wps.com/thumbnails/research-matters-issue-39-learners-annotations-and-written-markings-when-taking-a-digital-multiple-choice-test/580747.png","ImageObject",300,407,{"name":92,"@type":93},"Riley","Person",{"url":74,"name":95,"@type":96},"DocShare","Organization","application/pdf","2026-11-15","2026-10-15",true,{"@type":102,"interactionType":103,"userInteractionCount":34},"InteractionCounter",{"@type":104},"ViewAction",{"@type":106,"mainEntity":107},"FAQPage",[108,114,118],{"name":109,"@type":110,"acceptedAnswer":111},"What is the main focus of this research?","Question",{"text":112,"@type":113},"The study focuses on the kinds of written annotations or markings learners use to support their thinking in digital multiple-choice exams, and what support is needed.","Answer",{"name":115,"@type":110,"acceptedAnswer":116},"How was the study conducted?",{"text":117,"@type":113},"Fifty-two learners took a digital economics test with access to either scrap paper or a printed version of the test; learners completed a questionnaire, and most were interviewed, with some observed.",{"name":119,"@type":110,"acceptedAnswer":120},"What did the findings suggest about using scrap paper?",{"text":121,"@type":113},"The evidence shows considerable variation in how learners used paper materials. Scrap paper worked fairly well for some annotation types but not for others, and the results are informing further testing platform developments.","https://schema.org",{"og:url":83,"og:type":124,"og:title":65,"og:site_name":95,"og:description":67},"article",{"robots":126,"canonical":83},"index,follow",{"doc_id":128,"site_id":62},580747,1792188996,{"code":4,"msg":5,"data":131},{"doc_id":128,"user_id":132,"nickname":92,"user_avatar":133,"doc_module":4,"category_id":39,"category_name":40,"doc_title":65,"doc_description":67,"doc_content":134,"file_id":135,"file_url":136,"file_type":137,"file_size":138,"view_count":34,"is_deleted":4,"is_public":8,"is_downloadable":8,"audit_status":8,"page_count":139,"language":140,"language_code":63,"site_id":62,"html_lang":63,"table_of_contents":141,"faqs":142,"seo_title":143,"seo_description":67,"update_tm":144,"read_time":145,"preview_page_count":4},1374391975076,"https://ap-avatar.wpscdn.com/avatar/14000253ca4ec9f6853?x-image-process=image/resize,m_fixed,w_180,h_180&k=1783305029341752051","Research Matters / 39  \nA Cambridge University Press & Assessment publication ISSN: 1755-6031  \nJournal homepage: [https://www.cambridgeassessment.org.uk/our-research/all](https://www.cambridgeassessment.org.uk/our-research/all)published-resources/research-matters/  \nLearners’annotations and written markings when taking a digital multiple-choice test: What support is needed?  \nVictoria Crisp, Sylvia Vitello, Abdullah Ali Khan, Heather Mahy and Sarah Hughes  \nTo cite this article: Crisp, V., Vitello, S., Khan, A. A., Mahy, H., & Hughes, S. (2025). Learners’ annotations and written markings when taking a digital multiple-choice test: What support is needed? Research Matters: A Cambridge University Press & Assessment publication, 39, 90–109. [https://doi.org/10.17863/CAM.116171](https://doi.org/10.17863/CAM.116171)  \nTo link this article: [https://www.cambridgeassessment.org.uk/Images/research](https://www.cambridgeassessment.org.uk/Images/research)matters-39-learners-annotations-and-written-markings-when-taking-a-digitalmultiple-choice-test.pdf  \nAbstract:  \nThis research set out to enhance our understanding of the exam techniques and types of written annotations or markings that learners may wish to use to support their thinking when taking digital multiple-choice exams. Additionally, we aimed to further explore issues around the factors that contribute to learners writing less rough work and markings on scrap paper during a digital test than they write on paper-based tests, as observed in prior research.  \nIn this research, 52 learners attempted a digital economics test with access to either scrap paper or a print of the test. Some learners were observed in order to capture their interactions with the paper materials, all learners completed a questionnaire, and most learners were interviewed.  \nThe evidence collected provides insights regarding the types of annotations and written markings learners wished to use. Considerable variation was found in whether, and the extent to which, learners used paper materials. Scrap paper worked fairly well for some types of annotations or written markings, but not for others. The findings are informing additional developments to testing platform functionality.  \nCambridge University Press & Assessment is committed to making its documents accessible in accordance with the WCAG 2.1 Standard. We’re always looking to improve the accessibility of our documents. If you find any problems or you think we’re not meeting accessibility requirements, contact our team:  \nResearch Division, [ResearchDivision@cambridge.org](ResearchDivision@cambridge.org)  \nIf you need this document in a different format contact us, telling us your name, email address and requirements and we will respond within 15 working days.  \n© Cambridge University Press & Assessment 2025  \nFull Terms & Conditions of access and use can be found at  \nT&C: Terms and Conditions | Cambridge University Press & Assessment  \n© Cambridge University Press & Assessment 2025  \nLearners’annotations and written markings when taking a digital multiple-choice test: What support is needed?  \nVictoria Crisp (Research Division), Sylvia Vitello (Research Division), Abdullah Ali Khan (Education Digital Products and Services), Heather Mahy (Education Digital Products and Services) and Sarah Hughes (Education Futures Directorate)  \nIntroduction  \nWhile digital tests and exams are prevalent in many contexts, so far they are uncommon for general qualifications in England and for general qualifications available internationally that are based on the English assessment model. However, moves towards providing digital exams for appropriate general qualification contexts are now progressing at pace. Digital exams offer a variety of potential advantages over paper-based exams, for example: providing a better match to how learners conduct their school work in some subjects; assessing skills that are difficult to assess authentically in a paper-based exam (e.g., com","cbCailXTdasXtxRT","https://ap.wps.com/l/cbCailXTdasXtxRT","pdf",249681,21,"English","# Introduction\n## Validity and comparability considerations\n# Study approach and participants\n## Learners’ annotations across paper materials\n# Findings and implications\n## Informing testing platform functionality","[{\"question\":\"What is the main focus of this research?\",\"answer\":\"The study focuses on the kinds of written annotations or markings learners use to support their thinking in digital multiple-choice exams, and what support is needed.\"},{\"question\":\"How was the study conducted?\",\"answer\":\"Fifty-two learners took a digital economics test with access to either scrap paper or a printed version of the test; learners completed a questionnaire, and most were interviewed, with some observed.\"},{\"question\":\"What did the findings suggest about using scrap paper?\",\"answer\":\"The evidence shows considerable variation in how learners used paper materials. Scrap paper worked fairly well for some annotation types but not for others, and the results are informing further testing platform developments.\"}]","Research Matters - Issue 39 - Learners’ annotations and written markings when taking a digital multiple-choice test | PDF",1792038218,53]