[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"detail-sidebar-cat-0-en-105":3,"doc-seo-590202-105":59,"doc-detail-590202-en":130},{"code":4,"msg":5,"data":6},0,"success",[7,13,18,23,28,33,38,43,48,51,55],{"id":8,"doc_module":4,"doc_module_name":9,"category_name":10,"show_sort_weight":11,"slug":12},1,"Document","Story & Novel",90,"story-novel",{"id":14,"doc_module":4,"doc_module_name":9,"category_name":15,"show_sort_weight":16,"slug":17},2,"Literature",80,"literature",{"id":19,"doc_module":4,"doc_module_name":9,"category_name":20,"show_sort_weight":21,"slug":22},4,"Exam",70,"exam",{"id":24,"doc_module":4,"doc_module_name":9,"category_name":25,"show_sort_weight":26,"slug":27},5,"Comic",60,"comic",{"id":29,"doc_module":4,"doc_module_name":9,"category_name":30,"show_sort_weight":31,"slug":32},6,"Technology",50,"technology",{"id":34,"doc_module":4,"doc_module_name":9,"category_name":35,"show_sort_weight":36,"slug":37},7,"Healthcare",40,"healthcare",{"id":39,"doc_module":4,"doc_module_name":9,"category_name":40,"show_sort_weight":41,"slug":42},8,"Research & Report",30,"research-report",{"id":44,"doc_module":4,"doc_module_name":9,"category_name":45,"show_sort_weight":46,"slug":47},9,"Religion & Spirituality",20,"religion-spirituality",{"id":46,"doc_module":4,"doc_module_name":9,"category_name":49,"show_sort_weight":46,"slug":50},"World Cup","world-cup",{"id":52,"doc_module":4,"doc_module_name":9,"category_name":53,"show_sort_weight":52,"slug":54},10,"Lifestyle","lifestyle",{"id":56,"doc_module":4,"doc_module_name":9,"category_name":57,"show_sort_weight":24,"slug":58},19,"General","general",{"code":4,"msg":60,"data":61},"ok",{"site_id":62,"language":63,"slug":64,"title":65,"keywords":66,"description":67,"schema_data":68,"social_meta":123,"head_meta":125,"extra_data":127,"updated_unix":129},105,"en","designing-field-experiments-to-integrate-research-on-costs","Designing Field Experiments to Integrate Research on Costs","","Designing field experiments that evaluate educational policy requires more than estimating effects; policymakers also need rigorous cost and resource information. This article addresses the lack of guidance on integrating cost research into efficacy and effectiveness evaluations by using common evaluation frameworks and the ingredients method. The approach aims to strengthen study cohesion, improve efficiency, and produce higher-quality randomized field trial designs that connect implementation, costs, and outcomes for better policy use and replication.",{"@graph":69,"@context":122},[70,84,105],{"@type":71,"itemListElement":72},"BreadcrumbList",[73,77,79,82],{"item":74,"name":75,"@type":76,"position":8},"https://docshare.wps.com","Home","ListItem",{"item":78,"name":9,"@type":76,"position":14},"https://docshare.wps.com/document/",{"item":80,"name":40,"@type":76,"position":81},"https://docshare.wps.com/document/research-report/",3,{"item":83,"name":65,"@type":76,"position":19},"https://docshare.wps.com/document/designing-field-experiments-to-integrate-research-on-costs/590202/",{"url":83,"name":65,"@type":85,"image":86,"author":91,"headline":65,"publisher":94,"fileFormat":97,"inLanguage":63,"description":67,"dateModified":98,"datePublished":99,"encodingFormat":97,"isAccessibleForFree":100,"interactionStatistic":101},"DigitalDocument",{"url":87,"@type":88,"width":89,"height":90},"https://docshare.wps.com/thumbnails/designing-field-experiments-to-integrate-research-on-costs/590202.png","ImageObject",300,407,{"name":92,"@type":93},"Adam","Person",{"url":74,"name":95,"@type":96},"DocShare","Organization","application/pdf","2026-11-06","2026-10-15",true,{"@type":102,"interactionType":103,"userInteractionCount":24},"InteractionCounter",{"@type":104},"ViewAction",{"@type":106,"mainEntity":107},"FAQPage",[108,114,118],{"name":109,"@type":110,"acceptedAnswer":111},"Why is cost research necessary for policy evaluations beyond effect estimates?","Question",{"text":112,"@type":113},"Effectiveness evidence alone is not sufficient for policymaking; effects must be considered alongside the costs required to produce them to maximize public investment.","Answer",{"name":115,"@type":110,"acceptedAnswer":116},"What problem does the paper identify in current research practices on costs?",{"text":117,"@type":113},"Research proposals and papers often treat costs, implementation, and effects as separate, missing opportunities to integrate learning from cost components into effectiveness findings.",{"name":119,"@type":110,"acceptedAnswer":120},"How does the article propose to integrate cost research into field experiments?",{"text":121,"@type":113},"It uses common evaluation frameworks and builds on the ingredients method to guide the design of field experiments, aiming for cohesive, efficient, and higher-quality evaluations.","https://schema.org",{"og:url":83,"og:type":124,"og:title":65,"og:site_name":95,"og:description":67},"article",{"robots":126,"canonical":83},"index,follow",{"doc_id":128,"site_id":62},590202,1792231602,{"code":4,"msg":5,"data":131},{"doc_id":128,"user_id":132,"nickname":92,"user_avatar":133,"doc_module":4,"category_id":39,"category_name":40,"doc_title":65,"doc_description":67,"doc_content":134,"file_id":135,"file_url":136,"file_type":137,"file_size":138,"view_count":24,"is_deleted":4,"is_public":8,"is_downloadable":8,"audit_status":8,"page_count":139,"language":140,"language_code":63,"site_id":62,"html_lang":63,"table_of_contents":141,"faqs":142,"seo_title":143,"seo_description":67,"update_tm":144,"read_time":145,"preview_page_count":4},1374404737137,"https://ap-avatar.wpscdn.com/davatar_155a257f0dc6eb9ab79c44ca47cae57d","AERA Open  \nJanuary-December 2023, Vol. 9, No. 1, pp. 1–13 DOI: 10. 1177/23328584231171536  \nArticle reuse guidelines: [sagepub.com/journals-permissions](sagepub.com/journals-permissions)[ ](sagepub.com/journals-permissions)© The Author(s) 2023. [https://journals.sagepub.com/home/ero](https://journals.sagepub.com/home/ero)  \nDesigning Field Experiments to Integrate Research on Costs  \nA. Brooks Bowden  \nUniversity of Pennsylvania  \nAlthough experimental evaluations have been labeled the “gold standard” of evidence for policy (U.S. Department of Education, 2003), evaluations without an analysis of costs are not sufficient for policymaking (Monk, 1995; Ross et al., 2007). Funding organizations now require cost-effectiveness data in most evaluations of effects. Yet, there is little guidance on how to integrate research on costs into efficacy or effectiveness evaluations. As a result, research proposals andpapers are disjointed in the treatment of costs, implementation, and effects, and studies often miss opportunities to integrate what is learned from the cost component into what is learned about effectiveness. To address this issue, this paper uses common evaluation frameworks to provide guidance for integrating research on costs into the design of field experiments building on the ingredients method (Levin et al., 2018). The goal is to improve study design, resulting in more cohesive, efficient, and higherquality evaluations.  \nKeywords: cost-effectiveness, economic evaluation, economics of education, educational policy, experimental design, experimental research, policy evaluation design, program evaluation, randomized control trial, research methodology  \nIntroduction  \nInitiatives during the George W. Bush administration and the Obama administration set the stage for a “Golden Age of evidence-based policy” (Haskins, 2015) . Together, these administrations stressed the importance of internally valid effectiveness evidence to inform decisions to more efficiently allocate public resources in education. In 2002, the U.S. Department of Education’s Institute of Education Sciences (IES) was built upon this idea and set out to grow the experimental evidence available within the field of education. Randomized field trials were the focus of IES initially, as this method is the gold standard for effectiveness evidence (U.S. Department of Education, 2003) . Such studies, if executed properly, tell us if a particular program (broadly defined) achieves the goals it was designed to improve.  \nKnowing if an approach was found to impact the outcome as intended is necessary but not sufficient for policymaking when deciding among alternative options (Harris, 2008; Monk, 1995; Ross et al., 2007) . Effects must be considered alongside the costs required to produce them to maximize public investments (Levin, 2001; Levin & Belfield, 2015) . Such analyses, broadly called economic evaluation, include cost-effectiveness and benefit-cost analysis (Levin et al., 2018) . By including an economic component, the goal is to provide evidence of effectiveness and corresponding costs and implementation fidelity so that the evidence is useful in policy considerations of how to best allocate scarce resources  \nand to improve the likelihood of successful replication (Belfield & Bowden, 2019) .  \nMajor funders of policy and program evaluation in the United States—including IES, the Department of Labor, USAID, and others—now require evaluations to include a cost component through a cost-effectiveness or benefit-cost framework to ensure that the change in resources that produced effects are published in addition to program impacts. This expansion of expectations among funders has been a major challenge for researchers. Importantly, coursework on the methods of economic evaluation and on conducting research to estimate costs within field trials has been largely absent from predoctoral training (Clune, 2002; Harris, 2008; Levin, 2001, 2013; Rice, 1997). Unfortunately","cbCaihU9oCcCtAjD","https://ap.wps.com/l/cbCaihU9oCcCtAjD","pdf",524339,13,"English","# Introduction\n## Policy context and the need for cost-informed evidence\n## Economic evaluation as a policy requirement\n## Purpose and contribution of the paper\n# The ingredients method and data collection for cost studies\n## Common misconceptions in applying the method\n## Guidance for integrating costs into field experiments","[{\"question\":\"Why is cost research necessary for policy evaluations beyond effect estimates?\",\"answer\":\"Effectiveness evidence alone is not sufficient for policymaking; effects must be considered alongside the costs required to produce them to maximize public investment.\"},{\"question\":\"What problem does the paper identify in current research practices on costs?\",\"answer\":\"Research proposals and papers often treat costs, implementation, and effects as separate, missing opportunities to integrate learning from cost components into effectiveness findings.\"},{\"question\":\"How does the article propose to integrate cost research into field experiments?\",\"answer\":\"It uses common evaluation frameworks and builds on the ingredients method to guide the design of field experiments, aiming for cohesive, efficient, and higher-quality evaluations.\"}]","Designing Field Experiments to Integrate Research on Costs | PDF",1792069061,33]