[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-209276-en":3,"doc-seo-209276-105":31,"detail-sidebar-cat-0-en-105":92},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":21,"is_downloadable":21,"audit_status":21,"page_count":22,"language":23,"language_code":24,"site_id":25,"html_lang":24,"table_of_contents":26,"faqs":27,"seo_title":28,"seo_description":14,"update_tm":29,"read_time":30},209276,2336475104042,"Tawan","https://ap-avatar.wpscdn.com/avatar/22000c4c32af1715be0?x-image-process=image/resize,m_fixed,w_180,h_180&k=1786537525561427321",8,"Research & Report","Stakes and Signals - An Empirical Investigation of Muddled Information in Standardized Testing - Working Paper No. 32608","Examines a natural experiment in Brazil where similar students took the same standardized test either as a low-stakes school accountability exam or as a high-stakes admission exam for top universities. Using administrative data and a difference-in-differences design, the study finds that score gaps between high- and low-income students widen under higher stakes, consistent with increased test preparation by wealthier students. The higher-stakes setting also makes scores more informative about college outcomes. Overall, the “muddling” between ability and prep improves the quality of the score signal while exacerbating inequality.","NBER WORKING PAPER SERIES  \nSTAKES AND SIGNALS:  \nAN EMPIRICAL INVESTIGATION OF MUDDLED INFORMATION IN STANDARDIZED TESTING  \nGermán J. Reyes  \nEvan Riehl  \nRuqing Xu  \nWorking Paper 32608  \n[http://www.nber.org/papers/w32608](http://www.nber.org/papers/w32608)  \nNATIONAL BUREAU OF ECONOMIC RESEARCH  \n1050 Massachusetts Avenue  \nCambridge, MA 02138  \nJune 2024  \nFor helpful comments we thank Serena Canaan, William Dougan, Deborah Doukas, Jorge Luis García, Daniel Hamermesh, Navin Kartik, Pierre Mouganie, Eric Nielsen, Roberta Olivieri, Christiane Szerman, Christopher Walters, Russell Weinstein, and participants at various seminars and conferences. Adya Bhargava provided excellent research assistance. All errors are our own. The views expressed herein are those of the authors and do not necessarily reflect the views of the National Bureau of Economic Research.  \nNBER working papers are circulated for discussion and comment purposes. They have not been peer-reviewed or been subject to the review by the NBER Board of Directors that accompanies official NBER publications.  \n© 2024 by Germán J. Reyes, Evan Riehl, and Ruqing Xu. All rights reserved. Short sections of text, not to exceed two paragraphs, may be quoted without explicit permission provided that full credit, including © notice, is given to the source.  \nStakes and Signals: An Empirical Investigation of Muddled Information in Standardized Testing Germán J. Reyes, Evan Riehl, and Ruqing Xu  \nNBER Working Paper No. 32608 June 2024  \nJEL No. I23,I24,J24,M5  \nABSTRACT  \nWe examine a natural experiment in Brazil in which similar students took the same standardized test as either a low-stakes school accountability exam or a high-stakes admission exam for the country's top universities. Using administrative data and a difference-in-differences design, we find that test score gaps between high- and low-income students expanded on the high-stakes exam, consistent with wealthy students engaging in test prep. Yet the increase in stakes made scores more informative for students' college outcomes. Thus the \"muddling\" of information on natural ability and test prep improved the quality of the score signal, although it also exacerbated inequality.  \nGermán J. Reyes Middlebury College 1229 S Street Extension Middlebury, VT 05753 [greyes@middlebury.edu](greyes@middlebury.edu)  \nEvan Riehl  \nDepartment of Economics Cornell University  \n266 Ives Hall Ithaca, NY 14853 and NBER [eriehl@cornell.edu](eriehl@cornell.edu)  \nRuqing Xu Cornell University [rx24@cornell.edu](rx24@cornell.edu)  \nA data appendix is available at [http://www.nber.org/data-appendix/w32608](http://www.nber.org/data-appendix/w32608)  \n1. Introduction  \nSelecting the right talent is crucial to the success of organizations. A fundamental challenge faced by recruiters is incomplete information on candidate quality. To address this challenge, recruiters often rely on signals of candidate quality from mechanisms like standardized tests or case interviews. Yet candidates have an incentive to manipulate their signals through preparation or even outright cheating, particularly when the positions they are applying for are highly desirable.1  \nAn important question for the design of talent selection mechanisms is whether the potential for manipulation degrades the quality of the signal. Social scientists have long hypothesized that strategic manipulation erodes the reliability of signals, an idea that is known as Goodhart’s Law (Goodhart, 1975) or Campbell’s Law (Campbell, 1979) .2 Theoretical models of “muddled information”(Frankel and Kartik, 2019) show that, as the stakes of a mechanism increase, signals become more informative about an individual’s gaming ability and less informative about the natural action individuals would take absent signaling concerns.3 But it is theoretically ambiguous whether recruiters would prefer to observe signals of candidate quality with or without gaming. Gaming ability may reflect a candidate’s know","cbCaiacY2sd8W8d5","https://ap.wps.com/l/cbCaiacY2sd8W8d5","pdf",1179017,2,1,46,"English","en",105,"# Introduction","[{\"question\":\"What natural experiment does the paper analyze in Brazil?\",\"answer\":\"The paper studies Brazil where a test originally used as a low-stakes school accountability measure was repurposed into a high-stakes university admission exam, while keeping the test structure and taker composition fixed.\"},{\"question\":\"How do higher exam stakes affect gaps between high- and low-income students?\",\"answer\":\"Higher stakes expand test score gaps between high- and low-income students, consistent with wealthier students engaging more in test preparation.\"},{\"question\":\"Do stakes make test scores more or less informative for college outcomes?\",\"answer\":\"Higher stakes make test scores more informative for students’ college outcomes, even though they worsen inequality.\"}]","Stakes and Signals - An Empirical Investigation of Muddled Information in Standardized Testing - Working Paper No. 32608 | PDF",1788612031,116,{"code":4,"msg":32,"data":33},"ok",{"site_id":25,"language":24,"slug":34,"title":13,"keywords":35,"description":14,"schema_data":36,"social_meta":87,"head_meta":89,"extra_data":91,"updated_unix":29},"stakes-and-signals-an-empirical-investigation-of-muddled-information-in-standardized-testing-working-paper-no-32608","",{"@graph":37,"@context":86},[38,54,69],{"@type":39,"itemListElement":40},"BreadcrumbList",[41,45,48,51],{"item":42,"name":43,"@type":44,"position":21},"https://docshare.wps.com","Home","ListItem",{"item":46,"name":47,"@type":44,"position":20},"https://docshare.wps.com/document/","Document",{"item":49,"name":12,"@type":44,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":44,"position":53},"https://docshare.wps.com/document/stakes-and-signals-an-empirical-investigation-of-muddled-information-in-standardized-testing-working-paper-no-32608/209276/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":24,"description":14,"dateModified":62,"datePublished":63,"encodingFormat":61,"isAccessibleForFree":64,"interactionStatistic":65},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":42,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-09-11","2026-09-05",true,{"@type":66,"interactionType":67,"userInteractionCount":20},"InteractionCounter",{"@type":68},"ViewAction",{"@type":70,"mainEntity":71},"FAQPage",[72,78,82],{"name":73,"@type":74,"acceptedAnswer":75},"What natural experiment does the paper analyze in Brazil?","Question",{"text":76,"@type":77},"The paper studies Brazil where a test originally used as a low-stakes school accountability measure was repurposed into a high-stakes university admission exam, while keeping the test structure and taker composition fixed.","Answer",{"name":79,"@type":74,"acceptedAnswer":80},"How do higher exam stakes affect gaps between high- and low-income students?",{"text":81,"@type":77},"Higher stakes expand test score gaps between high- and low-income students, consistent with wealthier students engaging more in test preparation.",{"name":83,"@type":74,"acceptedAnswer":84},"Do stakes make test scores more or less informative for college outcomes?",{"text":85,"@type":77},"Higher stakes make test scores more informative for students’ college outcomes, even though they worsen inequality.","https://schema.org",{"og:url":52,"og:type":88,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":90,"canonical":52},"index,follow",{"doc_id":7,"site_id":25},{"code":4,"msg":5,"data":93},[94,98,102,106,111,116,121,124,129,132,136],{"id":21,"doc_module":4,"doc_module_name":47,"category_name":95,"show_sort_weight":96,"slug":97},"Story & Novel",90,"story-novel",{"id":20,"doc_module":4,"doc_module_name":47,"category_name":99,"show_sort_weight":100,"slug":101},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":47,"category_name":103,"show_sort_weight":104,"slug":105},"Exam",70,"exam",{"id":107,"doc_module":4,"doc_module_name":47,"category_name":108,"show_sort_weight":109,"slug":110},5,"Comic",60,"comic",{"id":112,"doc_module":4,"doc_module_name":47,"category_name":113,"show_sort_weight":114,"slug":115},6,"Technology",50,"technology",{"id":117,"doc_module":4,"doc_module_name":47,"category_name":118,"show_sort_weight":119,"slug":120},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":47,"category_name":12,"show_sort_weight":122,"slug":123},30,"research-report",{"id":125,"doc_module":4,"doc_module_name":47,"category_name":126,"show_sort_weight":127,"slug":128},9,"Religion & Spirituality",20,"religion-spirituality",{"id":127,"doc_module":4,"doc_module_name":47,"category_name":130,"show_sort_weight":127,"slug":131},"World Cup","world-cup",{"id":133,"doc_module":4,"doc_module_name":47,"category_name":134,"show_sort_weight":133,"slug":135},10,"Lifestyle","lifestyle",{"id":137,"doc_module":4,"doc_module_name":47,"category_name":138,"show_sort_weight":107,"slug":139},19,"General","general"]