[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-128518-en":3,"doc-seo-128518-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":21,"is_downloadable":21,"audit_status":21,"page_count":11,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},128518,687207017582,"Himbo","https://ap-avatar.wpscdn.com/davatar_994ba38a5ba835b3df7d355c54d3ed8d",8,"Research & Report","Comparison of Bayesian and particle swarm algorithms for hyperparameter optimisation in machine learning applications in high energy physics","Machine learning workflows require selecting numerous hyperparameters that strongly influence model performance. This paper compares particle swarm optimisation (PSO) and Bayesian optimisation (BO) for autonomous hyperparameter determination across machine learning tasks typical of high energy physics. The evaluation focuses on whether each method can effectively leverage highly parallel computing resources common in contemporary HEP experiments. Results assess performance relative to sequential execution on a single machine.","Comparison of Bayesian and particle swarm algorithms for hyperparameter optimisation in machine learning applications in high  \nenergy physics  \nTani, Laurits 1 [laurits. tani@cern. ch](laurits. tani@cern. ch)  \nVeelken, Christian 1 [Christian. Veelken@cern. ch](Christian. Veelken@cern. ch)  \narXiv:2201.06809v2 [[physics.data-an](physics.data-an)] 13 Oct 2023  \n1 National Institute Of Chemical Physics And Biophysics (NICPB), Akadeemia tee 23, 12618 Tallinn, Estonia  \nAbstract  \nWhen using machine learning (ML) techniques, users typically need to choose a plethora of algorithmspecific parameters, referred to as hyperparameters. In this paper, we compare the performance of two algorithms, particle swarm optimisation (PSO) and Bayesian optimisation (BO), for the autonomous determination of these hyperparameters in applications to different ML tasks typical for the field of high energy physics (HEP) . Our evaluation of the performance includes a comparison of the capability of the PSO and BO algorithms to make efficient use of the highly parallel computing resources that are characteristic of contemporary HEP experiments.  \nKeywords: hyperparameter optimization; high energy physics; evolutionary algorithms; machine learning  \n1 Introduction  \nMachine learning (ML) methods often aid the analysis of the vast amounts of data that are produced by contemporary high energy physics (HEP) experiments. The ML algorithms often feature tunable parameters, referred to as hyperparameters, which need to be chosen by the user and often have a significant effect on the algorithm’s performance. In a previous publication [1] we presented two different algorithms, particle swarm optimisation (PSO) and the genetic algorithm, for the autonomous determination of these hyperparameters. In the present paper we compare the performance of the PSO algorithm, the more promising of the two algorithms studied in our previous publication, to the performance of the Bayesian optimisation (BO) [2, 3, 4, 5, 6] algorithm. The latter is widely used for the task of finding optimal hyperparameter values in the context of ML applications since the pioneering work of Refs. [7, 8, 9] . The “asynchronous successive halving algorithm”(ASHA) [10] is an alternative algorithm for optimising the values of hyperparameters, which is popular in the ML community outside the field of HEP.  \nAs in our previous publication, we formulate the task of determining the set of optimal hyperparam-  \neter values as a function maximisation problem. More specifically, given an ML algorithm A, we seek to find a point h in the space H of hyperparameters, such that the performance of the ML algorithm A attains its maximum at this point:  \nˆh = argmax s (h) ,  \nh ∈ H  \nwhere the objective (or “score”) function (OF) s (h) quantifies the performance of the ML algorithm A, and the point h at which s (h) attains its maximum is denoted by the symbol ˆh . We compare the performance of the PSO and BO algorithms on two benchmark tasks, the task of finding the minimum of the Rosenbrock function [11], and on a typical data analysis task in the field of HEP, the “ATLAS Higgs boson machine learning challenge” [12] . An important aspect in applications of ML algorithms in the field of HEP is an algorithm’s capability to make efficient use of massively parallel computing facilities. A single training of an ML algorithm on a single machine may take several hours, days, or, in extreme cases, even weeks. In the context of the hyperparameter optimisation task, such a single training corresponds to a single evaluation of the OF s(h) . In order for the hyperparameter optimisation task to finish within an acceptable time, different evaluations of the OF, i. e. different ML trainings, need to be executed in parallel. The computing facilities of contemporary HEP experiments typically allow users concurrent access to hundreds, sometimes even thousands, of machines. It is there-  \nfore of high practical relevance whether t","cbCaiamIykcPkx6E","https://ap.wps.com/l/cbCaiamIykcPkx6E","pdf",485114,2,1,"English","en",105,"# Introduction\n## Hyperparameters in ML for HEP\n## Formulation as a function maximisation problem\n## Benchmark tasks and parallel evaluation\n# Bayesian Optimisation\n## Surrogate model and Gaussian process\n## Acquisition function and iterative optimisation","[{\"question\":\"What problem does the paper address in machine learning for high energy physics?\",\"answer\":\"It addresses how to autonomously determine ML hyperparameters, which otherwise must be chosen by the user and can significantly affect performance.\"},{\"question\":\"Which two optimisation algorithms are compared for hyperparameter tuning?\",\"answer\":\"The paper compares particle swarm optimisation (PSO) and Bayesian optimisation (BO) for hyperparameter optimisation.\"},{\"question\":\"How does the evaluation account for the computing environment of HEP experiments?\",\"answer\":\"It compares how efficiently PSO and BO use the massively parallel computing resources typical of contemporary high energy physics experiments, evaluating performance versus fully sequential execution.\"}]","Comparison of Bayesian and particle swarm algorithms for hyperparameter optimisation in machine learning applications in high energy physics | PDF",1786001508,20,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"comparison-of-bayesian-and-particle-swarm-algorithms-for-hyperparameter-optimization-in-machine-learning-applications-in-high-energy-physics","",{"@graph":36,"@context":85},[37,53,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,47,50],{"item":41,"name":42,"@type":43,"position":21},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":20},"https://docshare.wps.com/document/","Document",{"item":48,"name":12,"@type":43,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":43,"position":52},"https://docshare.wps.com/document/comparison-of-bayesian-and-particle-swarm-algorithms-for-hyperparameter-optimization-in-machine-learning-applications-in-high-energy-physics/128518/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":41,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-08-22","2026-08-06",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does the paper address in machine learning for high energy physics?","Question",{"text":75,"@type":76},"It addresses how to autonomously determine ML hyperparameters, which otherwise must be chosen by the user and can significantly affect performance.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"Which two optimisation algorithms are compared for hyperparameter tuning?",{"text":80,"@type":76},"The paper compares particle swarm optimisation (PSO) and Bayesian optimisation (BO) for hyperparameter optimisation.",{"name":82,"@type":73,"acceptedAnswer":83},"How does the evaluation account for the computing environment of HEP experiments?",{"text":84,"@type":76},"It compares how efficiently PSO and BO use the massively parallel computing resources typical of contemporary high energy physics experiments, evaluating performance versus fully sequential execution.","https://schema.org",{"og:url":51,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":51},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,127,130,134],{"id":21,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":20,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":29,"slug":126},9,"Religion & Spirituality","religion-spirituality",{"id":29,"doc_module":4,"doc_module_name":46,"category_name":128,"show_sort_weight":29,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":46,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":46,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]