[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-85430-en":3,"doc-seo-85430-105":29,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":13,"seo_description":14,"update_tm":27,"read_time":28},85430,1099513958762,"Logic","https://ap-avatar.wpscdn.com/avatar/1000023916a998db790?x-image-process=image/resize,m_fixed,w_180,h_180&k=1782109480056885918",8,"Research & Report","Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completion","FedMKGC targets training collaborative multimodal knowledge graph completion models across decentralized institutions while preventing sensitive multimodal knowledge transmission. The work introduces MMFeD3-HidE to address uncertain modality unavailability and heterogeneous clients. HidE reconstructs complete multimodal distributions from incomplete entity embeddings using available modalities, while MMFeD3 performs logit and feature dual distillation between clients and server to improve global convergence and semantic consistency. A FedMKGC benchmark and baselines validate the effectiveness, semantic consistency, and convergence robustness.","Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completion  \nYing Zhang, Member, IEEE, Yu Zhao, Xuhui Sui, Baohang Zhou, Xiangrui Cai, Li Shen, Member, IEEE,  \nXiaojie Yuan, Dacheng Tao, Fellow, IEEE  \narXiv :2506 .22036v2 [ cs .LG] 13 Jul 2026  \nAbstract—With the increasing multimodal knowledge privatization requirements, multimodal knowledge graphs in different institutes are usually decentralized, lacking of effective collaboration system with both stronger reasoning ability and transmission safety guarantees. In this paper, we propose the Federated Multimodal Knowledge Graph Completion (FedMKGC) task, aiming at training over federated MKGs for better predicting the missing links in clients without sharing sensitive knowledge. We propose a framework named MMFeD3-HidE for addressing multimodal uncertain unavailability and multimodal client heterogeneity challenges of FedMKGC. (1) Inside the clients, our proposed Hyper-modal Imputation Diffusion Embedding model (HidE) recovers the complete multimodal distributions from incomplete entity embeddings constrained by available modalities.  \n(2) Among clients, our proposed Multimodal FeDerated Dual Distillation (MMFeD3) transfers knowledge mutually between clients and the server with logit and feature distillation to improve both global convergence and semantic consistency. We propose a FedMKGC benchmark for a comprehensive evaluation, consisting of a general FedMKGC backbone named MMFedE, datasets with heterogeneous multimodal information, and three groups of constructed baselines. Experiments conducted on our benchmark validate the effectiveness, semantic consistency, and convergence robustness of MMFeD3-HidE.  \nIndex Terms—Multimodal Knowledge Graphs, Federated Learning, Multimodal Learning.  \nI. INTRODUCTION  \nMultimodal knowledge graphs (MKGs) [1], [2] organize graph structures composed of relational triples (head entity, relation, tail entity) and their visual and textual attributes as Figure 1, which have been widely in multimodal knowledgeintensive tasks [3]–[6] . Due to incomplete construction and  \nThis research was supported by the National Natural Science Foundation of China (No. 62272250, 62572260), the Natural Science Foundation of Tianjin, China (No. 22JCJQJC00150), and the Fundamental Research Funds for the Central Universities, Nankai University (No. 63253232) . The work of Yu Zhao was supported by the China Scholarship Council (No. 202506200065) .(Corresponding author: Yu Zhao.)  \nYing Zhang, Yu Zhao, Xuhui Sui, Xiangrui Cai, Xiaojie Yuan are with the College of Computer Science, VCIP, DISSec, Nankai University, Tianjin, China (e-mail: [yingzhang@nankai.edu.cn](yingzhang@nankai.edu.cn), [zhaoyu@dbis.nankai.edu.cn](zhaoyu@dbis.nankai.edu.cn), suix  \n[uhui@dbis.nankai.edu.cn](uhui@dbis.nankai.edu.cn), [caixr@nankai.edu.cn](caixr@nankai.edu.cn), [yuanxj@nankai.edu.cn](yuanxj@nankai.edu.cn)).  \nBaohang Zhou is with the School of Software, Tiangong University, Tianjin, China (e-mail: [zhoubaohang@tiangong.edu.cn](zhoubaohang@tiangong.edu.cn)).  \nLi Shen is with the Shenzhen Campus of Sun Yat-sen University, Shenzhen, China ([e-mail: mathshenli@gmail.com](e-mail: mathshenli@gmail.com)).  \nDacheng Tao is with the College of Computing and Data Science, Nanyang Technological University, Singapore (e-mail: [dacheng.tao@ntu.edu.sg](dacheng.tao@ntu.edu.sg)).  \n©2026 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.  \nPublished in IEEE Transactions on Multimedia. DOI: 10.1109/TMM.2026.3705201  \nFig. 1. Toy example of the FedMKGC task for decentralized MKGs. The client MKGs have uncertain unavailabl","cbCaiba7L4LeY3co","https://ap.wps.com/l/cbCaiba7L4LeY3co","pdf",6813354,1,16,"English","en",105,"# Introduction\n## Federated Multimodal Knowledge Graph Completion (FedMKGC)\n## MMFeD3-HidE framework\n## Hyper-modal Imputation Diffusion Embedding (HidE)\n## Multimodal FeDerated Dual Distillation (MMFeD3)\n## FedMKGC benchmark and experimental validation","[{\"question\":\"What problem does FedMKGC address?\",\"answer\":\"FedMKGC trains a global model to complete missing links across decentralized multimodal knowledge graphs while avoiding transmission of sensitive multimodal information.\"},{\"question\":\"How does HidE improve multimodal completion on a client?\",\"answer\":\"HidE recovers complete multimodal distributions from incomplete entity embeddings, constrained by modalities that are actually available on the client.\"},{\"question\":\"What role does MMFeD3 play in federated learning?\",\"answer\":\"MMFeD3 transfers knowledge between clients and the server via logit and feature distillation, improving global convergence and semantic consistency.\"}]",1784203423,40,{"code":4,"msg":30,"data":31},"ok",{"site_id":24,"language":23,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":27},"hyper-modal-imputation-diffusion-embedding-with-dual-distillation-for-federated-multimodal-knowledge-graph-completion","",{"@graph":35,"@context":85},[36,53,68],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/hyper-modal-imputation-diffusion-embedding-with-dual-distillation-for-federated-multimodal-knowledge-graph-completion/85430/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-17","2026-07-16",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does FedMKGC address?","Question",{"text":75,"@type":76},"FedMKGC trains a global model to complete missing links across decentralized multimodal knowledge graphs while avoiding transmission of sensitive multimodal information.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does HidE improve multimodal completion on a client?",{"text":80,"@type":76},"HidE recovers complete multimodal distributions from incomplete entity embeddings, constrained by modalities that are actually available on the client.",{"name":82,"@type":73,"acceptedAnswer":83},"What role does MMFeD3 play in federated learning?",{"text":84,"@type":76},"MMFeD3 transfers knowledge between clients and the server via logit and feature distillation, improving global convergence and semantic consistency.","https://schema.org",{"og:url":51,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":51},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,119,122,127,130,134],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":45,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":45,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":45,"category_name":117,"show_sort_weight":28,"slug":118},7,"Healthcare","healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":45,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":45,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":45,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":45,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]