[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"detail-sidebar-cat-0-en-105":3,"doc-detail-504571-en":59,"doc-seo-504571-105":80},{"code":4,"msg":5,"data":6},0,"success",[7,13,18,23,28,33,38,43,48,51,55],{"id":8,"doc_module":4,"doc_module_name":9,"category_name":10,"show_sort_weight":11,"slug":12},1,"Document","Story & Novel",90,"story-novel",{"id":14,"doc_module":4,"doc_module_name":9,"category_name":15,"show_sort_weight":16,"slug":17},2,"Literature",80,"literature",{"id":19,"doc_module":4,"doc_module_name":9,"category_name":20,"show_sort_weight":21,"slug":22},4,"Exam",70,"exam",{"id":24,"doc_module":4,"doc_module_name":9,"category_name":25,"show_sort_weight":26,"slug":27},5,"Comic",60,"comic",{"id":29,"doc_module":4,"doc_module_name":9,"category_name":30,"show_sort_weight":31,"slug":32},6,"Technology",50,"technology",{"id":34,"doc_module":4,"doc_module_name":9,"category_name":35,"show_sort_weight":36,"slug":37},7,"Healthcare",40,"healthcare",{"id":39,"doc_module":4,"doc_module_name":9,"category_name":40,"show_sort_weight":41,"slug":42},8,"Research & Report",30,"research-report",{"id":44,"doc_module":4,"doc_module_name":9,"category_name":45,"show_sort_weight":46,"slug":47},9,"Religion & Spirituality",20,"religion-spirituality",{"id":46,"doc_module":4,"doc_module_name":9,"category_name":49,"show_sort_weight":46,"slug":50},"World Cup","world-cup",{"id":52,"doc_module":4,"doc_module_name":9,"category_name":53,"show_sort_weight":52,"slug":54},10,"Lifestyle","lifestyle",{"id":56,"doc_module":4,"doc_module_name":9,"category_name":57,"show_sort_weight":24,"slug":58},19,"General","general",{"code":4,"msg":5,"data":60},{"doc_id":61,"user_id":62,"nickname":63,"user_avatar":64,"doc_module":4,"category_id":19,"category_name":20,"doc_title":65,"doc_description":66,"doc_content":67,"file_id":68,"file_url":69,"file_type":70,"file_size":71,"view_count":29,"is_deleted":4,"is_public":8,"is_downloadable":8,"audit_status":8,"page_count":8,"language":72,"language_code":73,"site_id":74,"html_lang":73,"table_of_contents":75,"faqs":76,"seo_title":77,"seo_description":66,"update_tm":78,"read_time":79,"preview_page_count":4},504571,7971461740886,"Theodore","https://ap-avatar.wpscdn.com/davatar_3d24733baf745e90a7e4bdd5f77d97b2","CAT-Screening-Methods-NASP-2022-Poster-Handout","Comparison of screening methods for computer adaptive tests (CAT) in education examines preventive frameworks, focusing on universal and gated screening designs. Using an extant dataset of 13,009 students in Grades 3–8, the study compares diagnostic accuracy for Star Reading and Star Math, alone or in combination, to predict end-of-year Smarter Balanced (SBAC) proficiency. Results identify an optimal single reading screener for reading, while math outcomes show similar performance across single and gated approaches, with gated methods yielding higher specificity.","Comparison of Screening Methods for Computer Adaptive Tests  \nEmily Forcht & Ethan R. Van Norman PhD  \nLehigh University, Bethlehem, PA  \n• Schools may implement preventive frameworks such as multi-tiered systems of support (MTSS) or Response to Intervention (RTI) in education to identify students who are at risk for academic failure and then provide those students with supplementary support.  \n• The first step in preventive frameworks is universal screening where educators administer brief assessments to all students in a building (Berkeley et al., 2009) .  \n• Unfortunately, the screening process is not perfect, and errors do occur .  \n• To decrease the number of screening errors, research has examined the idea of using multiple measures to inform screening outcomes (Fuchs et al., 2012) . Typically, using multiple screening measures improves the accuracy of the screening process (Van Meveren et al., 2020) .  \n• One method: Gated Screening Framework → multiple phases of screening  \n• First phase, all students are administered a screener and performance is evaluated.  \n• Second phase, students who are determined as “at risk” are administered a second screener .  \n• The purpose of the current study is to compare the diagnostic accuracy of using a single computer adaptive test (CAT), Star Reading or Star Math, or a combination of the two, in a gated screening framework, to predict end-of-year proficiency on reading and math tests .  \n• Research Questions: (1) What is the difference in diagnostic accuracy between a single screening method or a gated screening method to predict end-of-year proficiency in reading? (2) What is the difference in diagnostic accuracy between a single screening method or a gated screening framework to predict end-of-year proficiency in math?  \nINTRODUCTION  \nParticipants  \n• Extant dataset managed by Renaissance Learning  \n• 13,009 students in Grades 3-8  \n• 2058 Grade 3, 2081 Grade 4, 2074 Grade 5, 1991 Grade 6, 2417 Grade 7, and 2388 Grade 8  \nMeasures  \n• Star Reading (SR): CAT designed to assess reading achievement, developed by Renaissance Learning  \n• Star Math (SM): CAT designed to assess mathematical skills, developed by Renaissance Learning  \n• Smarter Balanced Assessment Consortium (SBAC): end-of-year statewide test that measures proficiency in reading and math, during the school year  \nMETHOD  \n• Single Screening Method: SR predicting proficiency on SBAC Reading; SR predicting proficiency on SBAC Math; SM predicting proficiency on SBAC Math; SM predicting proficiency on SBAC Reading  \n• Gated Screening Method: SR and SM to predict SBAC Reading; SM and Star Reading to predict SBAC Math.  \n• If a case scores below the 40th percentile on the first CAT, performance on the second CAT will be considered.  \n• The case will then be considered at risk if they score below the 40th percentile on the additional screening measure .  \n• The distribution of cases in four categories, True Positive (TP), True Negative (TN), False Positive (FP), and False Negative (FN) were displayed in a contingency table .  \n• Sensitivity (Sn): (TP)/ (TP+FN), Specificity (Sp): (TN) /(TN+FP), and Base Rate (BR): (TP+FN)/(TP+FN+FP+TN) were estimated based on the contingency tables .  \nANALYSIS  \nSCREENING METHODS DECISION TREES  \n| • |  The single screening method did not show extreme differences between  screening across topic areas and grades . |\n| --- | --- |\n| • | The only condition to yield sufficient Sn and Sp (>.70) was when a single reading screener predicted reading outcomes in all grades except grade 4. |\n| • | No conditions for math outcomes met sufficient Sn and Sp (>.70) . However, using a single reading screener showed slightly better results for Sn than a single math screener . |\n| • | The gated screening method yielded lower Sn and higher Sp values than the single screening method across grades and topic areas . |\n| • | The gated screening method when predicting both reading and math outcomes yielded extremely h","cbCaira2g2vzfNbR","https://ap.wps.com/l/cbCaira2g2vzfNbR","pdf",11482733,"English","en",105,"# Introduction\n## Participants\n## Measures\n# Method\n## Screening methods\n## Decision rules and metrics\n# Analysis\n## Screening methods decision trees\n# Results\n## Single vs gated screening\n## Predicting reading proficiency\n## Predicting math proficiency\n# Discussion","[{\"question\":\"What is the study’s main purpose regarding CAT screening methods?\",\"answer\":\"To compare the diagnostic accuracy of using a single computer adaptive test (Star Reading, Star Math, or a combination) versus a gated screening framework to predict end-of-year proficiency in reading and math.\"},{\"question\":\"How does the gated screening framework work in this study?\",\"answer\":\"All students take a first screener; those below the 40th percentile take a second screener. Students below the 40th percentile on the additional measure are considered at risk.\"},{\"question\":\"Which screening approach is optimal for reading and why?\",\"answer\":\"A single reading screener is optimal because it is the only method yielding sufficient sensitivity and specificity (Sn and Sp \\u003e 0.70) for predicting reading proficiency across grades and topic areas.\"}]","CAT-Screening-Methods-NASP-2022-Poster-Handout | PDF",1791070483,3,{"code":4,"msg":81,"data":82},"ok",{"site_id":74,"language":73,"slug":83,"title":65,"keywords":84,"description":66,"schema_data":85,"social_meta":138,"head_meta":140,"extra_data":142,"updated_unix":143},"cat-screening-methods-nasp-2022-poster-handout","",{"@graph":86,"@context":137},[87,100,120],{"@type":88,"itemListElement":89},"BreadcrumbList",[90,94,96,98],{"item":91,"name":92,"@type":93,"position":8},"https://docshare.wps.com","Home","ListItem",{"item":95,"name":9,"@type":93,"position":14},"https://docshare.wps.com/document/",{"item":97,"name":20,"@type":93,"position":79},"https://docshare.wps.com/document/exam/",{"item":99,"name":65,"@type":93,"position":19},"https://docshare.wps.com/document/cat-screening-methods-nasp-2022-poster-handout/504571/",{"url":99,"name":65,"@type":101,"image":102,"author":107,"headline":65,"publisher":109,"fileFormat":112,"inLanguage":73,"description":66,"dateModified":113,"datePublished":114,"encodingFormat":112,"isAccessibleForFree":115,"interactionStatistic":116},"DigitalDocument",{"url":103,"@type":104,"width":105,"height":106},"https://docshare.wps.com/thumbnails/cat-screening-methods-nasp-2022-poster-handout/504571.png","ImageObject",300,407,{"name":63,"@type":108},"Person",{"url":91,"name":110,"@type":111},"DocShare","Organization","application/pdf","2026-11-10","2026-10-03",true,{"@type":117,"interactionType":118,"userInteractionCount":29},"InteractionCounter",{"@type":119},"ViewAction",{"@type":121,"mainEntity":122},"FAQPage",[123,129,133],{"name":124,"@type":125,"acceptedAnswer":126},"What is the study’s main purpose regarding CAT screening methods?","Question",{"text":127,"@type":128},"To compare the diagnostic accuracy of using a single computer adaptive test (Star Reading, Star Math, or a combination) versus a gated screening framework to predict end-of-year proficiency in reading and math.","Answer",{"name":130,"@type":125,"acceptedAnswer":131},"How does the gated screening framework work in this study?",{"text":132,"@type":128},"All students take a first screener; those below the 40th percentile take a second screener. Students below the 40th percentile on the additional measure are considered at risk.",{"name":134,"@type":125,"acceptedAnswer":135},"Which screening approach is optimal for reading and why?",{"text":136,"@type":128},"A single reading screener is optimal because it is the only method yielding sufficient sensitivity and specificity (Sn and Sp > 0.70) for predicting reading proficiency across grades and topic areas.","https://schema.org",{"og:url":99,"og:type":139,"og:title":65,"og:site_name":110,"og:description":66},"article",{"robots":141,"canonical":99},"index,follow",{"doc_id":61,"site_id":74},1792119420]