[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-119158-en":3,"doc-seo-119158-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},119158,8796095461564,"Liam","https://ap-avatar.wpscdn.com/davatar_155a257f0dc6eb9ab79c44ca47cae57d",8,"Research & Report","FedCBO - Reaching Group Consensus in Clustered Federated Learning through Consensus-based Optimization","Federated learning integrates training across multiple users while protecting data privacy and respecting communication-loss constraints. Clustered federated learning additionally assumes an unknown group structure and aims to train useful models per group, not a single global model. The paper introduces FedCBO, a consensus-based optimization approach modeled with interacting particles independent of membership. A mean-field analysis characterizes the particle limit, and convergence guarantees establish simultaneous global optimization for general non-convex cluster losses in the mean-field regime.","FedCBO: Reaching Group Consensus in Clustered Federated Learning through Consensus-based Optimization  \nJos􀀓e A. Carrillo [carrillo@maths.ox.ac.uk](carrillo@maths.ox.ac.uk)  \nMathematical Institute University of Oxford Oxford OX2 6GG, UK  \nNicol􀀓as Garc􀀓􀀐a Trillos [garciatrillo@wisc.edu](garciatrillo@wisc.edu)  \nDepartment of Statistics  \nUniversity of Wisconsin-Madison  \n1300 University Avenue, Madison, Wisconsin 53706, USA  \nSixu Li [sli739@wisc.edu](sli739@wisc.edu)  \nDepartment of Statistics  \nUniversity of Wisconsin-Madison  \n1300 University Avenue, Madison, Wisconsin 53706, USA  \nYuhua Zhu [yuhua.zhu@stat.ucla.edu](yuhua.zhu@stat.ucla.edu)  \nDepartment of Statistics and Data Science, University of California, Los Angeles Los Angeles, California 90095-1554, USA  \nEditor: Qiang Liu  \nAbstract  \nFederated learning is an important framework in modern machine learning that seeks to integrate the training of learning models from multiple users, each user having their own local data set, in away that is sensitive to data privacy and to communication loss constraints. In clustered federated learning, one assumes an additional unknown group structure among users, and the goal is to train models that are useful for each group, rather than simply training a single global model for all users. In this paper, we propose a novel solution to the problem of clustered federated learning that is inspired by ideas in consensus-based optimization (CBO) . Our new CBO-type method is based on a system of interacting particles that is oblivious to group memberships. Our model is motivated by rigorous mathematical reasoning, which includes a mean-􀀌eld analysis describing the large number of particles limit of our particle system, as well as convergence guarantees for the simultaneous global optimization of general non-convex objective functions (corresponding to the loss functions of each cluster of users) in the mean-􀀌eld regime. Experimental results demonstrate the e􀀎cacy of our FedCBO algorithm compared to other state-of-the-art methods and help validate our methodological and theoretical work.  \nKeywords: consensus-based optimization, clustered federated learning, interacting particle system, mean-􀀌eld limit, asymptotic convergence analysis.  \n1. Introduction  \nThe wide use of internet of things (IoT) devices in various applications such as home automation, personal health monitoring, and vehicle-to-vehicle communications has led to the generation of vast amounts of data across a collective of users. However, concerns around data privacy and security, as well as limitations on communication costs and bandwidth, have made it challenging for an  \n􀀍c2024 Jos􀀓e A. Carrillo, Nicol􀀓as Garc􀀓􀀐a Trillos, Sixu Li and Yuhua Zhu.  \nLicense: CC-BY 4.0, see [https://creativecommons.org/licenses/by/4.0/](https://creativecommons.org/licenses/by/4.0/. Attribution)[. Attribution](https://creativecommons.org/licenses/by/4.0/. Attribution) requirements are provided at  \n[http://jmlr.org/papers/v25/23-0764.html](http://jmlr.org/papers/v25/23-0764.html).  \nCarrillo, Garca Trillos, Li and Zhu  \nindividual user to take advantage of this large amount of stored information. This has motivated the design and development of federated learning (FL) strategies, which aim at pooling information from learning models trained on local devices to build models without relying on the collection of local data (McMahan et al., 2017; Kairouz et al., 2021) .  \nStandard FL approaches aim to learn one global model for all local clients/users (McMahanet al., 2017; Li et al., 2020; Mohri et al., 2019; Karimireddy et al., 2020) . However, data heterogeneity, also known as [non-i.i.d. data](non-i.i.d. data) setting, naturally arises in FL applications since data are usually generated from users' personal devices. Thus, it is expected that no single global model can perform well across all clients (Sattler et al., 2020) . On the other hand, it is reasonable to expect that users with simila","cbCaiuJBsiXTRkWM","https://ap.wps.com/l/cbCaiuJBsiXTRkWM","pdf",884221,1,51,"English","en",105,"# Introduction\n## Federated learning and privacy/communication constraints\n## Clustered federated learning (CFL) and non-i.i.d. data\n## Problem setup: server, agents, unknown group partition\n# FedCBO overview and methodological motivation\n## Consensus-based optimization via interacting particles\n## Mean-field analysis and convergence guarantees\n# Experimental validation\n## Comparison to state-of-the-art methods\n## Efficacy and theoretical validation","[{\"question\":\"What problem does FedCBO address in clustered federated learning?\",\"answer\":\"FedCBO targets clustered federated learning where users belong to unknown groups and training should be effective for each group rather than only producing one global model.\"},{\"question\":\"How does the proposed method relate to consensus-based optimization?\",\"answer\":\"The solution is inspired by consensus-based optimization and formulates the approach using an interacting-particle system that does not rely on knowing group memberships.\"},{\"question\":\"What theoretical results are provided for FedCBO?\",\"answer\":\"The paper includes a mean-field analysis for the large number of particles limit and provides convergence guarantees for simultaneous global optimization of general non-convex objective functions in the mean-field regime.\"}]","FedCBO - Reaching Group Consensus in Clustered Federated Learning through Consensus-based Optimization | PDF",1785722795,129,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"fedcbo-reaching-group-consensus-in-clustered-federated-learning-through-consensus-based-optimization","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/fedcbo-reaching-group-consensus-in-clustered-federated-learning-through-consensus-based-optimization/119158/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-03",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does FedCBO address in clustered federated learning?","Question",{"text":75,"@type":76},"FedCBO targets clustered federated learning where users belong to unknown groups and training should be effective for each group rather than only producing one global model.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does the proposed method relate to consensus-based optimization?",{"text":80,"@type":76},"The solution is inspired by consensus-based optimization and formulates the approach using an interacting-particle system that does not rely on knowing group memberships.",{"name":82,"@type":73,"acceptedAnswer":83},"What theoretical results are provided for FedCBO?",{"text":84,"@type":76},"The paper includes a mean-field analysis for the large number of particles limit and provides convergence guarantees for simultaneous global optimization of general non-convex objective functions in the mean-field regime.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]