[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"detail-sidebar-cat-0-en-105":3,"doc-detail-595731-en":59,"doc-seo-595731-105":82},{"code":4,"msg":5,"data":6},0,"success",[7,13,18,23,28,33,38,43,48,51,55],{"id":8,"doc_module":4,"doc_module_name":9,"category_name":10,"show_sort_weight":11,"slug":12},1,"Document","Story & Novel",90,"story-novel",{"id":14,"doc_module":4,"doc_module_name":9,"category_name":15,"show_sort_weight":16,"slug":17},2,"Literature",80,"literature",{"id":19,"doc_module":4,"doc_module_name":9,"category_name":20,"show_sort_weight":21,"slug":22},4,"Exam",70,"exam",{"id":24,"doc_module":4,"doc_module_name":9,"category_name":25,"show_sort_weight":26,"slug":27},5,"Comic",60,"comic",{"id":29,"doc_module":4,"doc_module_name":9,"category_name":30,"show_sort_weight":31,"slug":32},6,"Technology",50,"technology",{"id":34,"doc_module":4,"doc_module_name":9,"category_name":35,"show_sort_weight":36,"slug":37},7,"Healthcare",40,"healthcare",{"id":39,"doc_module":4,"doc_module_name":9,"category_name":40,"show_sort_weight":41,"slug":42},8,"Research & Report",30,"research-report",{"id":44,"doc_module":4,"doc_module_name":9,"category_name":45,"show_sort_weight":46,"slug":47},9,"Religion & Spirituality",20,"religion-spirituality",{"id":46,"doc_module":4,"doc_module_name":9,"category_name":49,"show_sort_weight":46,"slug":50},"World Cup","world-cup",{"id":52,"doc_module":4,"doc_module_name":9,"category_name":53,"show_sort_weight":52,"slug":54},10,"Lifestyle","lifestyle",{"id":56,"doc_module":4,"doc_module_name":9,"category_name":57,"show_sort_weight":24,"slug":58},19,"General","general",{"code":4,"msg":5,"data":60},{"doc_id":61,"user_id":62,"nickname":63,"user_avatar":64,"doc_module":4,"category_id":39,"category_name":40,"doc_title":65,"doc_description":66,"doc_content":67,"file_id":68,"file_url":69,"file_type":70,"file_size":71,"view_count":72,"is_deleted":4,"is_public":8,"is_downloadable":8,"audit_status":8,"page_count":73,"language":74,"language_code":75,"site_id":76,"html_lang":75,"table_of_contents":77,"faqs":78,"seo_title":79,"seo_description":66,"update_tm":80,"read_time":81},595731,5909892330395,"Fans","https://ap-avatar.wpscdn.com/davatar_6f874abed73319feea01a86fa6f0fab8","Quantitative considerations for improving replicability in CALL and applied linguistics - Paper","The paper examines methodological practices in computer-assisted language learning (CALL) and applied linguistics that restrict research progress, especially in replication work. It presents two fabricated studies that reflect common field issues, then analyzes the problems each study illustrates. For every issue, the paper provides concrete comments and suggestions to modify analyses to increase replicability and/or replicational value. It concludes with quantitative reform recommendations aimed at strengthening replication research and broader quantitative practice in CALL and applied linguistics.","calico (online) issn 2056–9017  \nArticle  \nQuantitative considerations for improving replicability in CALL and applied linguistics  \nLuke Plonsky  \nAbstract  \nThere are a number of methodological practices commonly employed by CALL researchers that limit progress in the field. Some of these practices are particular to replication research, but most are more general and are found throughout applied linguistics. I describe in this paper two studies that are fabricated but that resemble much of what is found in the field. Each study corresponds to and contains a set of methodological issues. Following each study, I address the issues they illustrate, providing comments and suggestions for how the analyses could be modified to produce greater replicability and/or replicational value. I conclude with a summary of suggestions for quantitative reforms related to improving replication research and quantitative practices more generally in CALL and applied linguistics.  \nKeywords: computer-assisted language instruction; quantitative research methods; replication; SLA  \nAffiliation  \nNorthern Arizona University, Flagstaff, AZ, USA. email: [luke.plonsky@nau.edu](luke.plonsky@nau.edu)  \ncalico vol 32.2 2015 232–244 ©2015, equinox publishing  \ndoi : 10.1558/cj.v32i2.26857  \nLuke Plonsky 233  \nIntroduction  \nThere is broad consensus that replicability is fundamental to advancing scientific knowledge. This is perhaps especially true in the many subdomainsof applied linguistics, including computer assisted language learning (CALL), where there is an ever-pressing need to examine and establish the generalizability of technological resources across learners/populations, contexts, linguistic targets, computational tools, and so forth (see Smith & Schulze, 2013) . However, engaging in replication research and, conversely, producing research that is replicable, is not a given. Indeed, there are many forces – institutional, editorial, curricular, personal, and field-specific, to name a few – that deter scholars from engaging in replication/replicable research (see Porte, 2013) . Yet an additional and critical but often overlooked roadblock to replication research in the domain of CALL and throughout applied linguistics, is our handling of quantitative data.  \nIt may come as a surprise to some researchers that I (or anyone) would suggest that the statistical techniques in a given study would have much to do with its replicability or its potential contribution as a replication. In response to such a comment I would argue that the two are actually very closely related; our data handling actually has much to do with whether and to what extent our results are able to contribute to the larger substantive context in which each study is carried out and reported. Embracing an approach that recognizes this broader context is part of the synthetic-and replicatory-minded ethic argued for in recent years by a small but vocal number of applied linguists (Rebekha Abbuhl, Alison Mackey, John Norris, Lourdes Ortega, Charlene Polio, Graeme Porte, myself) . I recognize and have even demonstrated some progress in this area (e.g., Plonsky, 2014) . And of course, the publication of the special issue in which this article appears and other special issues of a similar orientation in the Journal of Second Language Writing (2012, Issue 4), for example, provide further evidence of the improved status of replication research. By and large, however, an individualistic view of knowledge development is still prevalent and evident in the way we conduct and present quantitative analyses. A synthetic and replicatory mindset, by contrast, pushes researchers working with the same or a similar set of constructs and processes to view their work as part ofa larger, collective, and connected body of research to be viewed, evaluated, and summarized in an ongoing and holistic fashion.  \nFurther and in an effort to cast this article to the widest audience possible, I want to be clear that I ","cbCaijG4BiDaxx13","https://ap.wps.com/l/cbCaijG4BiDaxx13","pdf",302753,3,13,"English","en",105,"# Introduction\n## Quantitative handling as a replication roadblock\n## Two sets of quantitative techniques\n## Example study 1\n## Research question and participant design","[{\"question\":\"What does the paper identify as a major but often overlooked obstacle to replication in CALL?\",\"answer\":\"It argues that the way quantitative data are handled is a critical, frequently overlooked roadblock to replication research in CALL and across applied linguistics.\"},{\"question\":\"How does the paper structure its discussion of replicability?\",\"answer\":\"It describes two fabricated studies that resemble typical work in the field, links each study to specific methodological issues, and then suggests analytic modifications to improve replicability and replicational value.\"},{\"question\":\"What is the intended outcome of the suggested quantitative reforms?\",\"answer\":\"The reforms aim to improve replication research and enhance quantitative practices more generally within CALL and applied linguistics by making results more able to contribute to the broader substantive research context.\"}]","Quantitative considerations for improving replicability in CALL and applied linguistics - Paper | PDF",1792081760,33,{"code":4,"msg":83,"data":84},"ok",{"site_id":76,"language":75,"slug":85,"title":65,"keywords":86,"description":66,"schema_data":87,"social_meta":140,"head_meta":142,"extra_data":144,"updated_unix":145},"quantitative-considerations-for-improving-replicability-in-call-and-applied-linguistics-paper","",{"@graph":88,"@context":139},[89,102,122],{"@type":90,"itemListElement":91},"BreadcrumbList",[92,96,98,100],{"item":93,"name":94,"@type":95,"position":8},"https://docshare.wps.com","Home","ListItem",{"item":97,"name":9,"@type":95,"position":14},"https://docshare.wps.com/document/",{"item":99,"name":40,"@type":95,"position":72},"https://docshare.wps.com/document/research-report/",{"item":101,"name":65,"@type":95,"position":19},"https://docshare.wps.com/document/quantitative-considerations-for-improving-replicability-in-call-and-applied-linguistics-paper/595731/",{"url":101,"name":65,"@type":103,"image":104,"author":109,"headline":65,"publisher":111,"fileFormat":114,"inLanguage":75,"description":66,"dateModified":115,"datePublished":116,"encodingFormat":114,"isAccessibleForFree":117,"interactionStatistic":118},"DigitalDocument",{"url":105,"@type":106,"width":107,"height":108},"https://docshare.wps.com/thumbnails/quantitative-considerations-for-improving-replicability-in-call-and-applied-linguistics-paper/595731.png","ImageObject",300,407,{"name":63,"@type":110},"Person",{"url":93,"name":112,"@type":113},"DocShare","Organization","application/pdf","2026-10-23","2026-10-15",true,{"@type":119,"interactionType":120,"userInteractionCount":72},"InteractionCounter",{"@type":121},"ViewAction",{"@type":123,"mainEntity":124},"FAQPage",[125,131,135],{"name":126,"@type":127,"acceptedAnswer":128},"What does the paper identify as a major but often overlooked obstacle to replication in CALL?","Question",{"text":129,"@type":130},"It argues that the way quantitative data are handled is a critical, frequently overlooked roadblock to replication research in CALL and across applied linguistics.","Answer",{"name":132,"@type":127,"acceptedAnswer":133},"How does the paper structure its discussion of replicability?",{"text":134,"@type":130},"It describes two fabricated studies that resemble typical work in the field, links each study to specific methodological issues, and then suggests analytic modifications to improve replicability and replicational value.",{"name":136,"@type":127,"acceptedAnswer":137},"What is the intended outcome of the suggested quantitative reforms?",{"text":138,"@type":130},"The reforms aim to improve replication research and enhance quantitative practices more generally within CALL and applied linguistics by making results more able to contribute to the broader substantive research context.","https://schema.org",{"og:url":101,"og:type":141,"og:title":65,"og:site_name":112,"og:description":66},"article",{"robots":143,"canonical":101},"index,follow",{"doc_id":61,"site_id":76},1792165705]