[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"detail-sidebar-cat-0-en-105":3,"doc-seo-580008-105":59,"doc-detail-580008-en":130},{"code":4,"msg":5,"data":6},0,"success",[7,13,18,23,28,33,38,43,48,51,55],{"id":8,"doc_module":4,"doc_module_name":9,"category_name":10,"show_sort_weight":11,"slug":12},1,"Document","Story & Novel",90,"story-novel",{"id":14,"doc_module":4,"doc_module_name":9,"category_name":15,"show_sort_weight":16,"slug":17},2,"Literature",80,"literature",{"id":19,"doc_module":4,"doc_module_name":9,"category_name":20,"show_sort_weight":21,"slug":22},4,"Exam",70,"exam",{"id":24,"doc_module":4,"doc_module_name":9,"category_name":25,"show_sort_weight":26,"slug":27},5,"Comic",60,"comic",{"id":29,"doc_module":4,"doc_module_name":9,"category_name":30,"show_sort_weight":31,"slug":32},6,"Technology",50,"technology",{"id":34,"doc_module":4,"doc_module_name":9,"category_name":35,"show_sort_weight":36,"slug":37},7,"Healthcare",40,"healthcare",{"id":39,"doc_module":4,"doc_module_name":9,"category_name":40,"show_sort_weight":41,"slug":42},8,"Research & Report",30,"research-report",{"id":44,"doc_module":4,"doc_module_name":9,"category_name":45,"show_sort_weight":46,"slug":47},9,"Religion & Spirituality",20,"religion-spirituality",{"id":46,"doc_module":4,"doc_module_name":9,"category_name":49,"show_sort_weight":46,"slug":50},"World Cup","world-cup",{"id":52,"doc_module":4,"doc_module_name":9,"category_name":53,"show_sort_weight":52,"slug":54},10,"Lifestyle","lifestyle",{"id":56,"doc_module":4,"doc_module_name":9,"category_name":57,"show_sort_weight":24,"slug":58},19,"General","general",{"code":4,"msg":60,"data":61},"ok",{"site_id":62,"language":63,"slug":64,"title":65,"keywords":66,"description":67,"schema_data":68,"social_meta":123,"head_meta":125,"extra_data":127,"updated_unix":129},105,"en","the-impact-of-external-resource-use-on-the-validity-of-score-interpretation-for-a-biology-concept-assessment-administered-out-of-class","The impact of external resource use on the validity of score interpretation for a biology concept assessment administered out-of-class","","Instructors use concept assessments to gauge student knowledge and support course improvement, yet time and logistics often limit in-class administration. Administering concept assessments out of class can increase feasibility, but external resource access may inflate scores and weaken claims that results reflect unaided understanding. This study surveyed undergraduate students using closed- and open-ended formats under a low-stakes out-of-class condition with instructions not to consult peers or other resources. Nearly half reported some external resource use, with open-ended responses showing less internet detail. Reported external resource use related to concept assessment scores, undermining score validity.",{"@graph":69,"@context":122},[70,84,105],{"@type":71,"itemListElement":72},"BreadcrumbList",[73,77,79,82],{"item":74,"name":75,"@type":76,"position":8},"https://docshare.wps.com","Home","ListItem",{"item":78,"name":9,"@type":76,"position":14},"https://docshare.wps.com/document/",{"item":80,"name":40,"@type":76,"position":81},"https://docshare.wps.com/document/research-report/",3,{"item":83,"name":65,"@type":76,"position":19},"https://docshare.wps.com/document/the-impact-of-external-resource-use-on-the-validity-of-score-interpretation-for-a-biology-concept-assessment-administered-out-of-class/580008/",{"url":83,"name":65,"@type":85,"image":86,"author":91,"headline":65,"publisher":94,"fileFormat":97,"inLanguage":63,"description":67,"dateModified":98,"datePublished":99,"encodingFormat":97,"isAccessibleForFree":100,"interactionStatistic":101},"DigitalDocument",{"url":87,"@type":88,"width":89,"height":90},"https://docshare.wps.com/thumbnails/the-impact-of-external-resource-use-on-the-validity-of-score-interpretation-for-a-biology-concept-assessment-administered-out-of-class/580008.png","ImageObject",300,407,{"name":92,"@type":93},"Asher","Person",{"url":74,"name":95,"@type":96},"DocShare","Organization","application/pdf","2026-11-15","2026-10-15",true,{"@type":102,"interactionType":103,"userInteractionCount":44},"InteractionCounter",{"@type":104},"ViewAction",{"@type":106,"mainEntity":107},"FAQPage",[108,114,118],{"name":109,"@type":110,"acceptedAnswer":111},"Why do instructors administer concept assessments out of class?","Question",{"text":112,"@type":113},"Out-of-class administration increases feasibility when instructors face time and logistical constraints, while helping support course improvement rather than student evaluation.","Answer",{"name":115,"@type":110,"acceptedAnswer":116},"How did the study measure students’ external resource use?",{"text":117,"@type":113},"Students completed the biology concept assessment under a low-stakes condition and then self-reported external resource use through closed-ended and open-ended questions.",{"name":119,"@type":110,"acceptedAnswer":120},"What impact did external resource use have on score interpretation?",{"text":121,"@type":113},"Reported external resource use was associated with concept assessment scores, suggesting that such behavior undermines interpreting scores as measures of unaided student knowledge.","https://schema.org",{"og:url":83,"og:type":124,"og:title":65,"og:site_name":95,"og:description":67},"article",{"robots":126,"canonical":83},"index,follow",{"doc_id":128,"site_id":62},580008,1792061797,{"code":4,"msg":5,"data":131},{"doc_id":128,"user_id":132,"nickname":92,"user_avatar":133,"doc_module":4,"category_id":39,"category_name":40,"doc_title":65,"doc_description":67,"doc_content":134,"file_id":135,"file_url":136,"file_type":137,"file_size":138,"view_count":44,"is_deleted":4,"is_public":8,"is_downloadable":8,"audit_status":8,"page_count":139,"language":140,"language_code":63,"site_id":62,"html_lang":63,"table_of_contents":141,"faqs":142,"seo_title":143,"seo_description":67,"update_tm":144,"read_time":145,"preview_page_count":4},687197207639,"https://ap-avatar.wpscdn.com/davatar_a8503ba1806abce46bf441b54a3ca4cd","| Research Article  \nThe impact of external resource use on the validity of score interpretation for a biology concept assessment administered out-of-class  \nTiffany J. Burgess,1 Crystal Uminski,1,2 Gia Alicea,1 Brian A. Couch1 AUTHOR AFFILIATIONS See affiliation list on p. 13.  \nABSTRACT Instructors use concept assessments to gauge student knowledge and guide course improvement. Many instructors experience time and logistical constraints around administering these assessments in class. For this reason, administering concept assessments outside of class can help increase feasibility. While previous studies have cautioned that the use of external resources (e.g., internet, course notes, peers) in the out-of-class setting may inflate assessment scores, the extent to which undergraduate students access various resources when completing concept assessments is unknown. The current study uses two survey question formats to better understand whether students engage with external resources when taking a biology concept assessment under a low-stakes out-of-class condition. Students were informed that they would receive participation credit for completing the assessment irrespective of the correctness of their responses and were asked not to consult their peers or other external resources. Immediately after the assessment, students self-reported on their external resource use via closed-ended and open-ended questions. Closed-ended questions revealed that nearly half (45%) of all students reported using external resources to some degree, while open-ended questions detected comparatively less resource use, particularly related to internet use. Reported resource use was associated with concept assessment scores, suggesting that this behavior undermines the interpretation of scores as measures of unaided student knowledge.  \nKEYWORDS concept assessment, external resource use, low-stakes assessment, out-of-class assessment, score interpretation, score validity, undergraduate, validity theory  \nA ccurate measurement of student conceptual understanding plays an important  \nrole in facilitating course and program improvement because information about how students score can help guide the development of improvement plans and help monitor the impact of instructional changes (1, 2) . Concept assessments are published instruments designed to gauge student understanding of key concepts within a topic, course, or program. For concept assessments to properly inform improvement, score interpretations need to be supported by evidence of validity, meaning that assessment scores should reflect students’ underlying unaided conceptual understanding (3, 4). Valid score interpretation enables instructors to accurately diagnose whether students have met an intended performance level (5, 6) .  \nWhile validity claims often present evidence that a given instrument assesses the targeted concepts, validity is not solely a property of the assessment tool but is also influenced by the assessment occasion and target population (6, 7) . Thus, validity encompasses the test administration conditions and considers whether students operate as intended. Under this broader conception, validity becomes a matter of  \nEditor Antonio Pedro Fonseca, Universidade do Porto, Porto, Portugal  \nAddress correspondence to Brian A. Couch, [bcouch2@unl.edu](bcouch2@unl.edu).  \nevaluating multifaceted arrays of evidence to make informed judgments regarding student capability (6, 8) . Inappropriate score interpretations may result when students do not follow directions for a particular assessment, even if the underlying instrument content is technically sound (6) .  \nMany instructors and researchers administer concept assessments online under a low-stakes out-of-class condition (9–11) . The low-stakes stem from students receiving credit for participating in the task (versus receiving credit based on the correctness of their responses), which aligns with the general goal of using the task fo","cbCainIo6FNXTYdz","https://ap.wps.com/l/cbCainIo6FNXTYdz","pdf",1861736,14,"English","# Abstract\n# Concept assessments and score validity\n## Validity as evidence beyond the instrument\n# Low-stakes out-of-class administration\n## Rationale and reported equivalence\n# Critiques and external resource access\n## Motivation and resource-use mechanisms\n# Prior evidence from physics studies","[{\"question\":\"Why do instructors administer concept assessments out of class?\",\"answer\":\"Out-of-class administration increases feasibility when instructors face time and logistical constraints, while helping support course improvement rather than student evaluation.\"},{\"question\":\"How did the study measure students’ external resource use?\",\"answer\":\"Students completed the biology concept assessment under a low-stakes condition and then self-reported external resource use through closed-ended and open-ended questions.\"},{\"question\":\"What impact did external resource use have on score interpretation?\",\"answer\":\"Reported external resource use was associated with concept assessment scores, suggesting that such behavior undermines interpreting scores as measures of unaided student knowledge.\"}]","The impact of external resource use on the validity of score interpretation for a biology concept assessment administered out-of-class | PDF",1792036760,35]