[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-118233-en":3,"doc-seo-118233-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},118233,1099514068035,"Ezra","https://ap-avatar.wpscdn.com/davatar_276721f389ce27ea32af1340a28f341c",8,"Research & Report","The role of hyperparameters in machine learning models and how to tune them - Research Note","Hyperparameters critically influence how well machine learning models perform on unseen, out-of-sample data. The study systematically compares different hyperparameter settings and evaluates how often hyperparameters and their tuning procedures are reported in political science research. Analysis of 64 manuscripts from three leading journals (2016–2021) shows that only 13 publications report both the hyperparameters and how they tuned them. The findings highlight risks of insufficient transparency and recommend making hyperparameter tuning and documentation a standard robustness-check component.","Boston University  \nOpenBU [http://open. bu.edu](http://open. bu.edu)  \nBU Open Access Articles BU Open Access Articles  \n2024-02-05  \nThe role of hyperparameters in machine learning models and how  \nto tune them  \nThis work was made openly accessible by BU Faculty. Please share how this access benefits you.  \nYour story matters.  \n\n| Version | Published version |\n| --- | --- |\n| Citation (published version): | Arnold C, Biedebach L, Küpfer A, Neunhoeffer M. The role of hyperparameters in machine learning models and how to tune them. Political Science Research and Methods. Published online 2024:1-8 .\u003Cbr>doi:10.1017/psrm.2023.61 |\n\n[https://hdl.handle.net/2144/49373](https://hdl.handle.net/2144/49373)[ ](https://hdl.handle.net/2144/49373)Boston University  \n[https://doi.org/10.1017/psrm.2023.61](https://doi.org/10.1017/psrm.2023.61) Published online by Cambridge University Press  \nPolitical Science Research and Methods (2024), page 1 of 8 doi:10.1017/psrm.2023.61  \nRESEARCH NOTE  \nThe role of hyperparameters in machine learning models and how to tune them  \nChristian Arnold 1 , Luka Biedebach2, Andreas Küpfer3  and Marcel Neunhoeffer4,5   \n1Department of Politics and International Relations, Cardiff University, Cardiff, UK, 2Department of Computer Science, Reykjavik University, Reykjavik, Iceland, 3Institute for Political Science, Technical University of Darmstadt, Darmstadt, Germany, 4Rafik B. Hariri Institute for Computing and Computational Science & Engineering, Boston University, Boston, MA, USA and 5Department of Statistics, LMU Munich, Munich, Germany  \nCorresponding author: Marcel Neunhoeffer; [Email: marcel@marcel-neunhoeffer.com](Email: marcel@marcel-neunhoeffer.com)[ ](Email: marcel@marcel-neunhoeffer.com)(Received 25 January 2022; revised 30 June 2023; accepted 5 July 2023)  \nAbstract  \nHyperparameters critically influence how well machine learning models perform on unseen, out-of-sample data. Systematically comparing the performance of different hyperparameter settings will often go along way in building confidence about a model’s performance. However, analyzing 64 machine learning related manuscripts published in three leading political science journals (APSR, PA, and PSRM) between 2016 and 2021, we find that only 13 publications (20.31 percent) report the hyperparameters and also how they tuned them in either the paper or the appendix. We illustrate the dangers of cursory attention to model and tuning transparency in comparing machine learning models’ capability to predict electoral violence from tweets. The tuning of hyperparameters and their documentation should become a standard component of robustness checks for machine learning models.  \nKeywords: Best Practice; Hyperparameter Optimization; Machine Learning  \n1 Why care about hyperparameters?  \nWhen political scientists work with machine learning models, they want to find a model that generalizes well from training data to new, unseen data.1 Hyperparameters play a key role in this endeavor because they determine the models’ capacity to generalize. Finding a good set of hyperparameters critically affects conclusions about a model’s performance. The failure to correctly tune and report hyperparameters has recently been identified as a key impediment to the accumulation of knowledge in computer science (e.g. Henderson et al., 2018; Melis et al., 2018; Bouthillier et al., 2019, 2021; Cooper et al., 2021; Gundersen et al., 2023) . Is political science making the same mistake?  \nWe examined 64 machine learning-related papers published between 1 January 2016 and 20 October 2021 in some of the top journals of our discipline—the American Political Science Review (APSR), Political Analysis (PA), and Political Science Research and Methods (PSRM) . Of the 64 publications we analyzed, 36 (56.25 percent) do not report the values of their hyperparameters, neither in the paper nor the appendix. Forty-nine publications (76.56 percent) do not share information about how they u","cbCaiutHGrMznChS","https://ap.wps.com/l/cbCaiutHGrMznChS","pdf",228359,1,9,"English","en",105,"# Why care about hyperparameters?\n## Impact on generalization and research conclusions\n## Evidence from political science journal manuscripts\n# Documenting tuning as robustness practice\n## Replication code and transparency concerns","[{\"question\":\"Why are hyperparameters important in machine learning models?\",\"answer\":\"Hyperparameters shape how well a model generalizes from training data to unseen data by determining the model’s capacity. Correct tuning is therefore central to reliable performance-based conclusions.\"},{\"question\":\"How often do political science papers report hyperparameters and tuning procedures?\",\"answer\":\"Among 64 analyzed machine-learning-related publications (2016–2021), only 13 (20.31%) reported the hyperparameters and how they tuned them. Many also omitted either hyperparameter values or tuning information.\"},{\"question\":\"What risks arise from limited transparency about tuning?\",\"answer\":\"When tuning choices are not documented, readers and reviewers cannot assess manuscript quality and cannot meaningfully evaluate or replicate the results. The paper argues this should be treated as a robustness-check issue.\"}]","The role of hyperparameters in machine learning models and how to tune them - Research Note | PDF",1785682481,23,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"the-role-of-hyperparameters-in-machine-learning-models-and-how-to-tune-them-research-note","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/the-role-of-hyperparameters-in-machine-learning-models-and-how-to-tune-them-research-note/118233/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-02",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"Why are hyperparameters important in machine learning models?","Question",{"text":75,"@type":76},"Hyperparameters shape how well a model generalizes from training data to unseen data by determining the model’s capacity. Correct tuning is therefore central to reliable performance-based conclusions.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How often do political science papers report hyperparameters and tuning procedures?",{"text":80,"@type":76},"Among 64 analyzed machine-learning-related publications (2016–2021), only 13 (20.31%) reported the hyperparameters and how they tuned them. Many also omitted either hyperparameter values or tuning information.",{"name":82,"@type":73,"acceptedAnswer":83},"What risks arise from limited transparency about tuning?",{"text":84,"@type":76},"When tuning choices are not documented, readers and reviewers cannot assess manuscript quality and cannot meaningfully evaluate or replicate the results. The paper argues this should be treated as a robustness-check issue.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,127,130,134],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":21,"doc_module":4,"doc_module_name":46,"category_name":124,"show_sort_weight":125,"slug":126},"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":46,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":46,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":46,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]