[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-116883-en":3,"doc-seo-116883-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},116883,687197100911,"Himbo","https://ap-avatar.wpscdn.com/avatar/a000239b6f1da00475?x-image-process=image/resize,m_fixed,w_180,h_180&k=1785132997149421697",8,"Research & Report","The Role of Hyperparameters in Machine Learning Models - How to Tune Them","Hyperparameters critically influence how machine learning models perform on unseen, out-of-sample data, and systematic comparison across settings builds confidence in model performance. Analyzing 64 articles from three leading political science journals (2016–2021) shows that only 13 (20.31%) report both hyperparameters and their tuning details. The findings highlight risks when model and tuning transparency are treated superficially, especially when predicting electoral violence from tweets. Hyperparameter documentation should become a standard robustness-check component.","ORCA – Online Research @ Cardiff  \nThis is an Open Access document downloaded from ORCA, Cardiff University' s institution al r epo sitory: [http s://orc a . c ardiff. ac. uk/id/ e print/ 1 6 0 9 3 7 /](http s://orc a . c ardiff. ac. uk/id/ e print/ 1 6 0 9 3 7 /)  \nThis is the author’s version of a work that was submitted to / accepted for  \npublication .  \nCitation for final published version:  \nArnold, Christian ORCID: [https://or cid.org / 0 0 0 0-0 0 0 2-7 0 4 2-5 9 4X](https://or cid.org / 0 0 0 0-0 0 0 2-7 0 4 2-5 9 4X), Bie de bach , Luka , Kü pfer, Andrea s and Ne un ho effer, Marcel 2 0 2 3 . The role of hyper parameters inm achine learning models and how to tune them. Political Science Research and  \nMethods file  \nPublisher s p ag e : [http s:// www.cambridge. org / core /journ als/ political-..](http s:// www.cambridge. org / core /journ als/ political-..) .  \nPlea se note :  \nChange s m ade a s a result of publishing processes such a s copy-editing, formatting and p age numbers m ay not be reflected in this version. For the definitive version of  \nthis publication, plea se refer to the published source. You are advised to consult the  \npublisher’s version if you wish to cite this p aper.  \nThis version is being m ade available in accord ance with publisher policies. See [http://orca . cf. ac. uk/ policies. html](http://orca . cf. ac. uk/ policies. html) for u s age policies. Copyright and mor al right s for publications m ade available in ORCA are retained by the copyright holders.  \nThe Role of Hyperparameters in Machine Learning Models and How to Tune Them  \nChristian Arnold 1 , Luka Biedebach2 , Andreas Küpfer« , and Marcel Neunhoeffer»,5  \n1 Cardiff University  \n2Reykjavik University  \n« Technical University of Darmstadt  \n» Boston University  \n5LMU Munich  \nDate: July 5th, 2023  \nAccepted for publication in Political Science Research and Methods  \nAbstract  \nHyperparameters critically in􀀝uence how well machine learning models perform on unseen, out-of-sample data. Systematically comparing the performance of di􀀛erent hyperparameter settings will often go a long way in building con􀀜dence about a model’s performance. However, analyzing 64 machine learning related manuscripts published in three leading political science journals (APSR, PA, and PSRM) between 2016 and 2021, we 􀀜nd that only  \n13 publications (20.31%) report the hyperparameters and also how they tuned them in either the paper or the appendix. We illustrate the dangers of cursory attention to model and tuning transparency in comparing machine learning models’ capability to predict electoral violence from tweets. The tuning of hyperparameters and their documentation should become a standard component of robustness checks for machine learning models.  \n1 Why Care about Hyperparameters?  \nWhen political scientists work with machine learning models, they want to find a model that generalizes well from training data to new, unseen data.1 Hyperparameters play a key role in this endeavor because they determine the models’ capacity to generalize. Finding a good set of hyperparameters critically affects conclusions about a model’s performance. The failure to correctly tune and report hyperparameters has recently been identified as a key impediment to the accumulation of knowledge in computer science (e.g. Bouthillier, Laurent and Vincent, 2019 ; Bouthillier et al., 2021 ; Cooper et al., 2021 ; Gundersen, Coakley and Kirkpatrick, 2022 ; Henderson et al., 2018 ; Melis, Dyer and Blunsom, 2018) . Is political science making the same mistake?  \nWe examined 6» machine learning-related papers published between 1 January 2016 and 20 October 2021 in some of the top journals of our discipline—the American Political Science Review (APSR), Political Analysis (PA), and Political Science Research and Methods (PSRM) . Of the 6» publications we analyzed, «6 (56.25%) do not report the values of their hyperparameters, neither in the paper nor the appendix. Forty-nine publicat","cbCaitBN9GIDRUNQ","https://ap.wps.com/l/cbCaitBN9GIDRUNQ","pdf",386167,1,34,"English","en",105,"# Abstract\n# Why Care about Hyperparameters?\n## Generalization and transparency\n## Empirical evidence from political science journals\n## Implications for robustness checks\n# What Are Hyperparameters and Why Do They Need to Be Tuned?","[{\"question\":\"Why do hyperparameters matter for machine learning model performance?\",\"answer\":\"Hyperparameters shape how a model generalizes from training data to unseen out-of-sample data. A good hyperparameter set strongly affects performance and conclusions.\"},{\"question\":\"What do the authors find about reporting and tuning practices in political science ML papers?\",\"answer\":\"In 64 papers (2016–2021), only 13 (20.31%) report hyperparameters and explain how they were tuned, and 46 (76.56%) do not describe tuning information.\"},{\"question\":\"Why is it risky when hyperparameters and tuning are not transparent?\",\"answer\":\"Without access to replication code and tuning details, readers and reviewers cannot assess manuscript quality. The paper argues this undermines the ability to evaluate results and replicate findings.\"}]","The Role of Hyperparameters in Machine Learning Models - How to Tune Them | PDF",1785672215,86,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"the-role-of-hyperparameters-in-machine-learning-models-how-to-tune-them","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/the-role-of-hyperparameters-in-machine-learning-models-how-to-tune-them/116883/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-02",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"Why do hyperparameters matter for machine learning model performance?","Question",{"text":75,"@type":76},"Hyperparameters shape how a model generalizes from training data to unseen out-of-sample data. A good hyperparameter set strongly affects performance and conclusions.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"What do the authors find about reporting and tuning practices in political science ML papers?",{"text":80,"@type":76},"In 64 papers (2016–2021), only 13 (20.31%) report hyperparameters and explain how they were tuned, and 46 (76.56%) do not describe tuning information.",{"name":82,"@type":73,"acceptedAnswer":83},"Why is it risky when hyperparameters and tuning are not transparent?",{"text":84,"@type":76},"Without access to replication code and tuning details, readers and reviewers cannot assess manuscript quality. The paper argues this undermines the ability to evaluate results and replicate findings.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]