[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-123800-en":3,"doc-seo-123800-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},123800,3848291630094,"Emma Wilson","https://eur-avatar.wpscdn.com/davatar_085a072bc5b1113ac321206ff7593b45",8,"Research & Report","Identifying Rapid-Guessing Behaviors - Response Time Threshold - Item Response Theory - Machine Learning Methods","Low-stakes assessments can attract unmotivated test takers who exhibit disengaged patterns, including rapid responses with short response times, threatening the validity of score inferences. The dissertation compares multiple rapid-guessing detection approaches, including response time threshold methods, item response theory based methods, and a neural-network autoencoder using anomaly detection. A simulation study evaluates (a) classification accuracy and (b) motivation filtering effects on person and item parameter estimates, with extensions to PISA data and additional gradient boosting analyses for process variables.","Identifying Rapid-Guessing Behaviors: Comparison of Response Time Threshold, Item Response Theory, and Machine Learning Methods  \n\n| Item Type | Dissertation (Open Access) |\n| --- | --- |\n| Authors | Lee , Minhyeong |\n| DOI | 10.7275/36471360 |\n| Rights | Attribution 4.0 International |\n| Download date | 2026-04-14 01:09:28 |\n| Item License | [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/) |\n| Link to Item | [https://hdl.handle. net/20.500.14394/19461](https://hdl.handle. net/20.500.14394/19461) |\n\nIdentifying Rapid-Guessing Behaviors: Comparison of Response Time Threshold, Item Response Theory, and Machine Learning Methods  \nA Dissertation Presented  \nby  \nMINHYEONG LEE  \nSubmitted to the Graduate School of the University of Massachusetts Amherst in partial fulfillment of the requirements for the degree of  \nDOCTOR OF PHILOSOPHY  \nFebruary 2024  \nCollege of Education  \nResearch, Educational Measurement, and Psychometrics  \n© Copyright by Minhyeong Lee 2024 All Rights Reserved  \nIdentifying Rapid-Guessing Behaviors: Comparison of Response Time Threshold, Item Response Theory, and Machine Learning Methods  \nA Dissertation Presented  \nby  \nMINHYEONG LEE  \nApproved as to style and content by:  \n\n| Scott Monroe, Chair |\n| --- |\n| Stephen G. Sireci, Member |\n\nFrederic Robin, Member  \nShane Hammond  \nAssociate Dean for Student Success College of Education  \nACKNOWLEDGEMENTS  \nI extend my profound appreciation to my academic advisor and the chair of the committee, Dr. Scott Monroe. His guidance, mentorship, and support have played a crucial role in shaping the path of my research and academic pursuits. I am truly grateful to have had him as my advisor during my time at UMass.  \nI express sincere gratitude to Dr. Steve Sireci for his invaluable insights and thoughtful contributions as a committee member. Beyond his academic guidance, Dr. Sireci has opened doors to great opportunities throughout my journey, and I am thankful for the doors he has helped me unlock.  \nA special note of appreciation goes to Dr. Frederic Robin, my final committee member, whose guidance led me into the captivating field of rapid-guessing research. I deeply appreciate his expertise in aberrant testing behaviors and PISA data.  \nMy heartfelt gratitude goes out to my family—my mother, father, and sister. Their unwavering support, often expressed simply through their presence, has been my anchor throughout this long journey. To my husband, Tyler Seabury, I extend my deepest thanks for his unwavering support and constant encouragement. His steadfast belief in my capabilities has been my greatest source of strength.  \nI extend my appreciation to my friends and REMP family for their camaraderie and support throughout this challenging yet rewarding journey.  \nTruly, I feel fortunate to have each of you in my life.  \nABSTRACT  \nIdentifying Rapid-Guessing Behaviors: Comparison of Response Time Threshold, Item Response Theory, and Machine Learning Methods  \nFebruary 2024  \nMINHYEONG LEE, B.A., SUNGKYUNKWAN UNIVERSITY  \nM.A., SUNGKYUNKWAN UNIVERSITY  \nM. S., UNIVERSITY OF MASSACHUSETTS AMHERST  \nPh.D., UNIVERSITY OF MASSACHUSETTS AMHERST  \nDirected by: Professor Scott Monroe  \nOn low-stake tests, unmotivated test takers may show disengaged behaviors, such as rapid responses with short response times and such non-effortful responses can be a threat to the test score validity. Several methods have been proposed to determine rapidguessing behavior, which can be classified as response time threshold methods and item response theory based methods. In addition, I suggest a machine learning method based on neural networks known as the autoencoder for anomaly detection. This research aims to compare the detection of rapid-guessing using various methods and their effects on inferences drawn from test data. In the simulation study,(a) the classification accuracy of the methods and (b) the effects of motivation filtering, i.e., removing r","cbCaiarOZRcNij5Z","https://ap.wps.com/l/cbCaiarOZRcNij5Z","pdf",7122841,1,188,"English","en",105,"# Acknowledgements\n# Abstract\n# Table of Contents\n# Chapter 1 Introduction\n## Background\n## Statement of the Problem and Its Significance\n## Purpose of Study\n# Chapter 2 Literature Review\n## Rapid-Gue","[{\"question\":\"Why is detecting rapid-guessing important in low-stakes tests?\",\"answer\":\"Rapid-guessing behaviors, such as fast responding with short response times, can reflect disengagement. These patterns can threaten the validity of test score inferences.\"},{\"question\":\"What classes of rapid-guessing detection methods does the research compare?\",\"answer\":\"The study compares response time threshold methods, item response theory based methods, and a machine learning approach using a neural-network autoencoder for anomaly detection.\"},{\"question\":\"How does the dissertation evaluate the methods and their consequences for test inference?\",\"answer\":\"A simulation study compares classification accuracy and assesses how motivation filtering—removing rapid guesses—affects person and item parameter estimates. The work further uses PISA data and gradient boosting to analyze predictive variables.\"}]","Identifying Rapid-Guessing Behaviors - Response Time Threshold - Item Response Theory - Machine Learning Methods | PDF",1785818624,474,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"identifying-rapid-guessing-behaviors-response-time-threshold-item-response-theory-machine-learning-methods","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/identifying-rapid-guessing-behaviors-response-time-threshold-item-response-theory-machine-learning-methods/123800/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-04",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"Why is detecting rapid-guessing important in low-stakes tests?","Question",{"text":75,"@type":76},"Rapid-guessing behaviors, such as fast responding with short response times, can reflect disengagement. These patterns can threaten the validity of test score inferences.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"What classes of rapid-guessing detection methods does the research compare?",{"text":80,"@type":76},"The study compares response time threshold methods, item response theory based methods, and a machine learning approach using a neural-network autoencoder for anomaly detection.",{"name":82,"@type":73,"acceptedAnswer":83},"How does the dissertation evaluate the methods and their consequences for test inference?",{"text":84,"@type":76},"A simulation study compares classification accuracy and assesses how motivation filtering—removing rapid guesses—affects person and item parameter estimates. The work further uses PISA data and gradient boosting to analyze predictive variables.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]