[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-119676-en":3,"doc-seo-119676-105":30,"detail-sidebar-cat-0-en-105":87},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},119676,1099513958607,"Jiven","https://ap-avatar.wpscdn.com/avatar/100002390cf8733938c?x-image-process=image/resize,m_fixed,w_180,h_180&k=1778829742770036399",8,"Research & Report","SoK: Training Machine Learning Models over Multiple Sources with Privacy Preservation - Secure Multi-party Learning and Federated Learning Survey","Training high-quality machine learning models across multiple data controllers with privacy preservation is a central challenge in the big-data era. Secure Multi-party Learning (MPL) and Federated Learning (FL) are two mainstream solution directions, each with distinct privacy guarantees, communication patterns, overhead, data formats, model accuracy, and deployment scenarios. This survey defines the TMMPP problem, compares recent technical routes, parties, partitioning, threat models, and supported learning models, reviews state-of-the-art platforms for online training, and outlines future directions.","View metadata, citation and similar [papers at ](papers at core.ac.uk)[core.ac.uk](papers at core.ac.uk) brought to you by CORE  \n[provided by](provided by arXiv.org)[ arXiv.org](provided by arXiv.org) e-Print Archive  \nSoK: Training Machine Learning Models over Multiple Sources with Privacy Preservation  \nLushan Song, Haoqi Wu, Wenqiang Ruan, Weili Han  \nLaboratory for Data Analytics and Security, Fudan University  \narXiv :2012 .03386v 1 [ cs .CR] 6 Dec 2020  \nAbstract—Nowadays, gathering high-quality training data from multiple data controllers with privacy preservation is a key challenge to train high-quality machine learning models. The potential solutions could dramatically break the barriers among isolated data corpus, and consequently enlarge the range of data available for processing. To this end, both academia researchers and industrial vendors are recently strongly motivated to propose two main-stream folders of solutions: 1) Secure Multi-party Learning (MPL for short); and 2) Federated Learning (FL for short). These two solutions have their advantages and limitations when we evaluate them from privacy preservation, ways of communication, communication overhead, format of data, the accuracy of trained models, and application scenarios.  \nMotivated to demonstrate the research progress and discuss the insights on the future directions, we thoroughly investigate these protocols and frameworks of both MPL and FL. At first, we define the problem of training machine learning models over multiple data sources with privacy-preserving (TMMPP for short). Then, we compare the recent studies of TMMPP from the aspects of the technical routes, parties supported, data partitioning, threat model, and supported machine learning models, to show the advantages and limitations. Next, we introduce the state-of-theart platforms which support online training over multiple data sources. Finally, we discuss the potential directions to resolve the problem of TMMPP.  \nI. INTRODUCTION  \nIn the era of big data, almost all online activities are driven by data. As is said by IBM's Chief Executive Officer that“big data is the new oil”, the data would bring us huge benefits, therefore have become the key in current business competitions. In addition, these data are pushing the advances of machine learning which have brought us such breakthroughsin various scenarios, such as medical diagnosis [1][2], imageclassification [3], and facial recognition [4] . In such aforementioned widely-applied scenarios, massive amounts of highquality data are the dominating factor in the performance of the machine learning models.  \nHowever, researchers are faced with a tough predicament where the needed data are hard to be collected and shared directly to jointly train high-performance machine learning models, because these data protected by privacy protection policies or regulations might contain much sensitive or private information, and are usually stored in multiple locations. Recently, the released laws, such as General Data Protection Regulation (GDPR) [5] which is presented by the European Union, aggravates this predicament during data sharing. Here, GDPR defines three key roles in data sharing: the data subject, which refers that “an identified or identifiable natural person who owns the personal data”; the data controller, which refers  \nthat “the natural or legal person, public authority, agency or other body which, alone or jointly with others, determines the purposes and means of the processing of personal data”; and the data processor, which refers that “a natural or legal person, public authority, agency or other body which processes personal data on behalf of the controller”. The role considered in this paper is the data controller.  \nHow to utilize the decentralized data in multiple data controllers to train high-performance machine learning models efficiently with privacy preservation is a key challenge. In this challenging scenario, the data controllers own v","cbCaidTSS1oqc1b2","https://ap.wps.com/l/cbCaidTSS1oqc1b2","pdf",519503,1,17,"English","en",105,"# Introduction\n## Training with privacy preservation across multiple data controllers\n## TMMPP overview and two mainstream solution directions\n## Problem definition and comparative evaluation (MPL vs FL)\n# Survey scope and motivation","[{\"question\":\"What does TMMPP mean in this document?\",\"answer\":\"TMMPP stands for training machine learning models over multiple data sources with privacy-preserving constraints. It is the core problem the survey investigates.\"},{\"question\":\"What are the next steps after defining and comparing TMMPP approaches?\",\"answer\":\"The survey introduces state-of-the-art platforms that support online training over multiple data sources, then discusses potential future directions to resolve TMMPP.\"}]","SoK: Training Machine Learning Models over Multiple Sources with Privacy Preservation - Secure Multi-party Learning and Federated Learning Survey | PDF",1785725699,43,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":82,"head_meta":84,"extra_data":86,"updated_unix":28},"sok-training-machine-learning-models-over-multiple-sources-with-privacy-preservation-secure-multi-party-learning-and-federated-learning-survey","",{"@graph":36,"@context":81},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/sok-training-machine-learning-models-over-multiple-sources-with-privacy-preservation-secure-multi-party-learning-and-federated-learning-survey/119676/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-03",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77],{"name":72,"@type":73,"acceptedAnswer":74},"What does TMMPP mean in this document?","Question",{"text":75,"@type":76},"TMMPP stands for training machine learning models over multiple data sources with privacy-preserving constraints. It is the core problem the survey investigates.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"What are the next steps after defining and comparing TMMPP approaches?",{"text":80,"@type":76},"The survey introduces state-of-the-art platforms that support online training over multiple data sources, then discusses potential future directions to resolve TMMPP.","https://schema.org",{"og:url":52,"og:type":83,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":85,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":88},[89,93,97,101,106,111,116,119,124,127,131],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":90,"show_sort_weight":91,"slug":92},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Exam",70,"exam",{"id":102,"doc_module":4,"doc_module_name":46,"category_name":103,"show_sort_weight":104,"slug":105},5,"Comic",60,"comic",{"id":107,"doc_module":4,"doc_module_name":46,"category_name":108,"show_sort_weight":109,"slug":110},6,"Technology",50,"technology",{"id":112,"doc_module":4,"doc_module_name":46,"category_name":113,"show_sort_weight":114,"slug":115},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":117,"slug":118},30,"research-report",{"id":120,"doc_module":4,"doc_module_name":46,"category_name":121,"show_sort_weight":122,"slug":123},9,"Religion & Spirituality",20,"religion-spirituality",{"id":122,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":122,"slug":126},"World Cup","world-cup",{"id":128,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":128,"slug":130},10,"Lifestyle","lifestyle",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":102,"slug":134},19,"General","general"]