[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-128004-en":3,"doc-seo-128004-105":31,"detail-sidebar-cat-0-en-105":92},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":21,"is_downloadable":21,"audit_status":21,"page_count":22,"language":23,"language_code":24,"site_id":25,"html_lang":24,"table_of_contents":26,"faqs":27,"seo_title":28,"seo_description":14,"update_tm":29,"read_time":30},128004,962084928904,"Asher","https://ap-avatar.wpscdn.com/davatar_155a257f0dc6eb9ab79c44ca47cae57d",8,"Research & Report","Searches for the BSM scenarios at the LHC using decision tree based machine learning algorithms - A comparative study and review of Random Forest, AdaBoost, XGboost and LightGBM frameworks","Machine learning algorithms are used to separate rare signals from overwhelming backgrounds in high energy physics. This work surveys decision tree methods in Standard Model and Supersymmetry contexts, summarizing machine learning foundations and the operating principles of Random Forest, AdaBoost, XGBoost, and LightGBM. A case study on electroweakino production at the high-luminosity LHC shows improved search sensitivity over traditional cut-based approaches in compressed and non-compressed R-parity conserving SUSY scenarios, including hyperparameter optimization and SHapley-value feature-importance analysis.","arXiv :2405 .06040v1 [hep-ph] 9 May 2024  \nSearches for the BSM scenarios at the LHC using decision tree based machine learning algorithms: A comparative study and review of Random Forest, Adaboost, XGboost and LightGBM frameworks  \nArghya Choudhury, Arpita Mondal, and Subhadeep Sarkar  \nDepartment of Physics, Indian Institute of Technology Patna, Bihar - 801106, India  \nE-mail: [arghya@iitp. ac. in](arghya@iitp. ac. in), arpita   [1921ph15@iitp. ac. in](1921ph15@iitp. ac. in),  \nsubhadeep   [1921ph21@iitp. ac. in](1921ph21@iitp. ac. in)  \nAbstract: Machine learning algorithms are now being extensively used in our daily lives, spanning across diverse industries as well as academia. In the field of high energy physics (HEP), the most common and challenging task is separating a rare signal from a much larger background. The boosted decision tree (BDT) algorithm has been a cornerstone of the high energy physics for analyzing event triggering, particle identification, jet tagging, object reconstruction, event classification, and other related tasks for quite some time. This article presents a comprehensive overview of research conducted by both HEP experimental and phenomenological groups that utilize decision tree algorithms in the context of the Standard Model and Supersymmetry (SUSY) . We also summarize the basic concept of machine learning and decision tree algorithm along with the working principle of Random Forest, AdaBoost and two gradient boosting frameworks, such as XGBoost, and LightGBM. Using a case study of electroweakino productions at the high luminosity LHC, we demonstrate how these algorithms lead to improvement in the search sensitivity compared to traditional cutbased methods in both compressed and non-compressed R-parity conserving SUSY scenarios. The effect of different hyperparameters and their optimization, feature importance study using SHapley values are also discussed in detail.  \nContents  \n1 Introduction 1  \n2 Basic concepts of machine learning 3  \n2.1 Loss Function 4  \n2.2 Overfitting and underfitting 5  \n2.3 Measures of classification performance 6  \n3 Machine learning in High Energy Physics 9  \n3.1 Signal and background events classification 12  \n3.1.1 Searches for RPC SUSY scenarios using BDT 13  \n3.1.2 Searches for RPV SUSY scenarios using BDT 19  \n4 Decision Tree algorithms 20  \n4.1 Random Forest 23  \n4.2 AdaBoost 25  \n4.3 XGBoost 27  \n4.4 LightGBM 29  \n5 Performance of different Decision Tree based algorithms-a RPCSUSY case study at the HL-LHC 31  \n5.1 Cut-and-count analysis 34  \n5.2 Machine Learning based analysis 36  \n5.2.1 Hyperparameter variation for different algorithms 37  \n5.2.2 Feature importance with SHapley 39  \n5.2.3 Comparison of results coming from different algorithms 41  \n6 Summary 43  \nBibliography 45  \n7 Appendix 58  \n1 Introduction  \nSupersymmetry (SUSY) [1–3] is one of the most compelling extensions of beyond the Standard Model (BSM) scenario, and the pursuit of supersymmetric partners of the SM particles (sparticles) remains as a primary objective at the Large Hadron Collider (LHC) . Since the inception of the LHC, both the ATLAS and CMS collaborationshave already conducted numerous searches to explore the SUSY particles utilizing the LHC Run-I and Run-II dataset [4 , 5] . In the absence of any statistical deviations from the SM predictions, the LHC has set stringent lower bounds on the masses of particles. For example, in the R-parity conserving (RPC) SUSY 1 scenarios with relonstoTeattpVihrvee(meslymet1pae)ligssacthtesndiveneofthlyue[tgll4rauig, 5ilnh]inootesdes(mtpe(c01)ad,)ri,fignthrsingetooLtn(Hwomth1gRunener) uptbran-IIatochal3raihas eght sTeVtios,xtendedquarks1 6 TeVand thet(s,hm1imeqe2p)l,oTliwertheeVfied blamiognuhdondtes1delst2s assumptions.  \nIt is important to note that the accumulated luminosity of Run-II data is approximately ∼ 140 fb−1, which is about 5% of the luminosity of planned upgrade of high luminosity LHC (HL-LHC) run (L = 3000fb−1) . The LHC Collaboratio","cbCaihbs2zjW94Gz","https://ap.wps.com/l/cbCaihbs2zjW94Gz","pdf",3709423,2,1,62,"English","en",105,"# Introduction\n# Basic concepts of machine learning\n## Loss Function\n## Overfitting and underfitting\n## Measures of classification performance\n# Machine learning in High Energy Physics\n## Signal and background events classification\n## Searches for RPC SUSY scenarios using BDT\n## Searches for RPV SUSY scenarios using BDT\n# Decision Tree algorithms\n## Random Forest\n## AdaBoost\n## XGBoost\n## LightGBM\n# Performance of different Decision Tree based algorithms-a RPC SUSY case study at the HL-LHC\n## Cut-and-count analysis\n## Machine Learning based analysis\n## Hyperparameter variation for different algorithms\n## Feature importance with SHapley\n## Comparison of results coming from different algorithms\n# Summary","[{\"question\":\"Why are decision tree based machine learning methods important for BSM searches at the LHC?\",\"answer\":\"They help separate rare signal events from much larger backgrounds, improving classification performance. The paper highlights their role in BDT-based and gradient-boosting searches for SUSY scenarios.\"},{\"question\":\"Which decision tree frameworks are compared in the study?\",\"answer\":\"Random Forest, AdaBoost, XGBoost, and LightGBM are reviewed and compared. Their principles and how they are used in HEP classification are summarized.\"},{\"question\":\"How does the case study on electroweakino production at the HL-LHC evaluate performance?\",\"answer\":\"It demonstrates improved search sensitivity compared with traditional cut-and-count methods in both compressed and non-compressed R-parity conserving SUSY scenarios. It also analyzes hyperparameter effects and feature importance using SHapley values.\"}]","Searches for the BSM scenarios at the LHC using decision tree based machine learning algorithms - A comparative study and review of Random Forest, AdaBoost, XGboost and LightGBM frameworks | PDF",1785943770,156,{"code":4,"msg":32,"data":33},"ok",{"site_id":25,"language":24,"slug":34,"title":13,"keywords":35,"description":14,"schema_data":36,"social_meta":87,"head_meta":89,"extra_data":91,"updated_unix":29},"searches-for-the-bsm-scenarios-at-the-lhc-using-decision-tree-based-machine-learning-algorithms-a-comparative-study-and-review-of-random-forest-adaboost-xgboost-and-lightgbm-frameworks","",{"@graph":37,"@context":86},[38,54,69],{"@type":39,"itemListElement":40},"BreadcrumbList",[41,45,48,51],{"item":42,"name":43,"@type":44,"position":21},"https://docshare.wps.com","Home","ListItem",{"item":46,"name":47,"@type":44,"position":20},"https://docshare.wps.com/document/","Document",{"item":49,"name":12,"@type":44,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":44,"position":53},"https://docshare.wps.com/document/searches-for-the-bsm-scenarios-at-the-lhc-using-decision-tree-based-machine-learning-algorithms-a-comparative-study-and-review-of-random-forest-adaboost-xgboost-and-lightgbm-frameworks/128004/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":24,"description":14,"dateModified":62,"datePublished":63,"encodingFormat":61,"isAccessibleForFree":64,"interactionStatistic":65},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":42,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-26","2026-08-05",true,{"@type":66,"interactionType":67,"userInteractionCount":20},"InteractionCounter",{"@type":68},"ViewAction",{"@type":70,"mainEntity":71},"FAQPage",[72,78,82],{"name":73,"@type":74,"acceptedAnswer":75},"Why are decision tree based machine learning methods important for BSM searches at the LHC?","Question",{"text":76,"@type":77},"They help separate rare signal events from much larger backgrounds, improving classification performance. The paper highlights their role in BDT-based and gradient-boosting searches for SUSY scenarios.","Answer",{"name":79,"@type":74,"acceptedAnswer":80},"Which decision tree frameworks are compared in the study?",{"text":81,"@type":77},"Random Forest, AdaBoost, XGBoost, and LightGBM are reviewed and compared. Their principles and how they are used in HEP classification are summarized.",{"name":83,"@type":74,"acceptedAnswer":84},"How does the case study on electroweakino production at the HL-LHC evaluate performance?",{"text":85,"@type":77},"It demonstrates improved search sensitivity compared with traditional cut-and-count methods in both compressed and non-compressed R-parity conserving SUSY scenarios. It also analyzes hyperparameter effects and feature importance using SHapley values.","https://schema.org",{"og:url":52,"og:type":88,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":90,"canonical":52},"index,follow",{"doc_id":7,"site_id":25},{"code":4,"msg":5,"data":93},[94,98,102,106,111,116,121,124,129,132,136],{"id":21,"doc_module":4,"doc_module_name":47,"category_name":95,"show_sort_weight":96,"slug":97},"Story & Novel",90,"story-novel",{"id":20,"doc_module":4,"doc_module_name":47,"category_name":99,"show_sort_weight":100,"slug":101},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":47,"category_name":103,"show_sort_weight":104,"slug":105},"Exam",70,"exam",{"id":107,"doc_module":4,"doc_module_name":47,"category_name":108,"show_sort_weight":109,"slug":110},5,"Comic",60,"comic",{"id":112,"doc_module":4,"doc_module_name":47,"category_name":113,"show_sort_weight":114,"slug":115},6,"Technology",50,"technology",{"id":117,"doc_module":4,"doc_module_name":47,"category_name":118,"show_sort_weight":119,"slug":120},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":47,"category_name":12,"show_sort_weight":122,"slug":123},30,"research-report",{"id":125,"doc_module":4,"doc_module_name":47,"category_name":126,"show_sort_weight":127,"slug":128},9,"Religion & Spirituality",20,"religion-spirituality",{"id":127,"doc_module":4,"doc_module_name":47,"category_name":130,"show_sort_weight":127,"slug":131},"World Cup","world-cup",{"id":133,"doc_module":4,"doc_module_name":47,"category_name":134,"show_sort_weight":133,"slug":135},10,"Lifestyle","lifestyle",{"id":137,"doc_module":4,"doc_module_name":47,"category_name":138,"show_sort_weight":107,"slug":139},19,"General","general"]