[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-85232-en":3,"doc-seo-85232-105":29,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":13,"seo_description":14,"update_tm":27,"read_time":28},85232,13056703019662,"Evangeline","https://ap-avatar.wpscdn.com/avatar/be000253a8e92610077?_k=1778726343310543188",8,"Research & Report","MRUF: 多粒度路由与不确定性引导融合的鲁棒多模态情感分析","Multimodal sentiment analysis integrates language, vision, and acoustic cues, yet utterance-level modality quality can fluctuate due to occlusion, noise, motion blur, or transcript errors, causing conventional fusion to over-rely on unreliable signals. MRUF introduces reliability-aware fusion with multi-granularity routing and uncertainty-aware calibration. It summarizes sentiment-relevant representations, estimates utterance-level modality importance via leave-one-out error increases, predicts modality-wise uncertainty, and refines modality gates using inverse-variance reweighting, stabilized by modality-invariant contrastive alignment. Experiments on CMU-MOSI and CMU-MOSEI show consistent gains, with higher predicted uncertainty receiving lower fusion weights.","MRUF: Multi-granularity Routing with Uncertainty-Aware Fusion for Robust Multimodal  \nSentiment Analysis†  \nHaoran Ma 1 ,2 ,3 ,4 ,5 , Yinfeng Yu 1 ,2 ,3 ,4 ,5 ,B , and Liejun Wang 1 ,2 ,3 ,4 ,5  \narXiv :2607 . 10599v 1 [ cs .AI] 12 Jul 2026  \nAbstract—Multimodal sentiment analysis relies on language, visual, and acoustic cues, but utterance-level modality quality may vary due to occlusion, background noise, motion blur, or imperfect transcripts, causing conventional fusion to over-trust unreliable modalities. We propose MRUF, a reliability-aware fusion method that combines multi-granularity routing with uncertainty-aware calibration. MRUF summarizes sentimentrelevant representations, performs subspace-and modality-level routing, and supervises modality routing with leave-one-out error increases to estimate utterance-level modality importance. It further predicts modality-wise uncertainty and refines modality gates through inverse-variance reweighting, while modality-invariant contrastive alignment stabilizes the shared representation space. Experiments on CMU-MOSI and CMUMOSEI under aligned and unaligned settings show consistent improvements over strong baselines, and mechanism analysis verifies that modalities with higher predicted uncertainty receive lower fusion weights.  \nIndex Terms— multimodal sentiment analysis, reliabilityaware fusion, uncertainty-aware fusion, modality routing, contrastive alignment.  \nI. INTRODUCTION  \nMultimodal sentiment analysis predicts sentiment by jointly modeling language, visual, and acoustic cues [1], [2],[3] . It is important for human-centered intelligent systems, such as human–machine interaction, driver monitoring, intelligent tutoring, and affective decision support. In practice, multimodal signals are often asynchronous, heterogeneous, and uneven in quality: visual streams may suffer from occlusion, motion blur, or head-pose changes; acoustic signals may be affected by background noise or channel variation; and transcripts may be incomplete or inaccurate. Such quality fluctuations can make a model over-trust unreliable evidence and produce unstable predictions.  \nExisting studies mainly improve multimodal sentiment analysis through cross-modal interaction and robust representation learning. Fusion methods capture modality correlations via tensor fusion, low-rank fusion, attention, graph interaction, progressive alignment, or interaction enhancement [4],  \n†This work was supported in part by the National Natural Science Foundation of China under Grant Nos. 62463029 and 62472368 .  \n1 School of Computer Science and Technology, Xinjiang University, Urumqi 830017, China.  \n2Joint International Research Laboratory of Silk Road Multilingual Cognitive Computing.  \n3Xinjiang Multimodal Intelligent Processing and Information Security Engineering Technology Research Center.  \n4Pengcheng Laboratory Xinjiang Network Node.  \n5Embodied Intelligence Joint Laboratory.  \nBYinfeng Yu is the corresponding author (Email: yuyin[feng@xju.edu.cn](feng@xju.edu.cn)).  \n[5], [6], [7], [8], [9], while robust methods handle missing or degraded modalities through calibration, contrastive learning, reconstruction, dynamic weighting, expert modeling, or modality-invariant distillation [10], [11], [12], [13], [14] . Similar reliability concerns also appear in audio-visual navigation, vision-and-language navigation, audio-visual source separation, speech processing, and visual detail enhancement [15], [16], [17], [18], [19], [20] . However, modality importance is often learned implicitly, and uncertainty is rarely used to directly calibrate modality weights during final fusion.  \nThese issues remain even with strong representation backbones. Disentangled or decoupled models improve representation quality by separating modality-invariant and modalityspecific factors or transferring knowledge across modalities [21], [22] . Nevertheless, a degraded modality may still receive excessive influence if final fusion is not gui","cbCailQql51kfpoI","https://ap.wps.com/l/cbCailQql51kfpoI","pdf",986723,1,6,"English","en",105,"# Introduction\n# Related Work\n## Multimodal Sentiment Analysis","[{\"question\":\"What problem does MRUF address in multimodal sentiment analysis?\",\"answer\":\"MRUF targets the reliability mismatch caused by utterance-level modality quality variation, where conventional fusion can over-trust occluded, noisy, blurred, or inaccurately transcribed modalities, leading to unstable predictions.\"},{\"question\":\"How does MRUF estimate the importance of each modality for an utterance?\",\"answer\":\"MRUF supervises modality routing using leave-one-out error increases to infer utterance-level modality importance.\"},{\"question\":\"How does MRUF use uncertainty to improve fusion?\",\"answer\":\"MRUF predicts modality-wise uncertainty and calibrates modality gates with inverse-variance reweighting, so modalities with higher predicted uncertainty receive lower fusion weights.\"}]",1784201888,15,{"code":4,"msg":30,"data":31},"ok",{"site_id":24,"language":23,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":27},"mruf-multi-granularity-routing-with-uncertainty-aware-fusion-for-robust-multimodal-sentiment-analysis","",{"@graph":35,"@context":85},[36,53,68],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/mruf-multi-granularity-routing-with-uncertainty-aware-fusion-for-robust-multimodal-sentiment-analysis/85232/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-24","2026-07-16",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does MRUF address in multimodal sentiment analysis?","Question",{"text":75,"@type":76},"MRUF targets the reliability mismatch caused by utterance-level modality quality variation, where conventional fusion can over-trust occluded, noisy, blurred, or inaccurately transcribed modalities, leading to unstable predictions.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does MRUF estimate the importance of each modality for an utterance?",{"text":80,"@type":76},"MRUF supervises modality routing using leave-one-out error increases to infer utterance-level modality importance.",{"name":82,"@type":73,"acceptedAnswer":83},"How does MRUF use uncertainty to improve fusion?",{"text":84,"@type":76},"MRUF predicts modality-wise uncertainty and calibrates modality gates with inverse-variance reweighting, so modalities with higher predicted uncertainty receive lower fusion weights.","https://schema.org",{"og:url":51,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":51},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,114,119,122,127,130,134],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":45,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":21,"doc_module":4,"doc_module_name":45,"category_name":111,"show_sort_weight":112,"slug":113},"Technology",50,"technology",{"id":115,"doc_module":4,"doc_module_name":45,"category_name":116,"show_sort_weight":117,"slug":118},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":45,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":45,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":45,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":45,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]