[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-seo-327295-105":3,"detail-sidebar-cat-0-en-105":81,"doc-detail-327295-en":131},{"code":4,"msg":5,"data":6},0,"ok",{"site_id":7,"language":8,"slug":9,"title":10,"keywords":11,"description":12,"schema_data":13,"social_meta":74,"head_meta":76,"extra_data":78,"updated_unix":80},105,"en","on-the-utility-and-factual-reliability-of-pruned-mixture-of-experts-models-in-the-biomedical-domain","On the Utility and Factual Reliability of Pruned Mixture-of-Experts Models in the Biomedical Domain","","Mixture-of-Experts (MoE) models accelerate inference through selective activation but keep the full network loaded, creating high memory costs. Structured expert pruning reduces deployment expenses in resource-limited environments, yet prior work mainly measures benchmark utility and rarely examines how pruning affects factual reliability, especially in high-stakes biomedicine. This study evaluates four MoE models, six pruning methods, and multiple pruning ratios across generation and classification tasks in-domain and cross-domain.",{"@graph":14,"@context":73},[15,34,56],{"@type":16,"itemListElement":17},"BreadcrumbList",[18,23,27,31],{"item":19,"name":20,"@type":21,"position":22},"https://docshare.wps.com","Home","ListItem",1,{"item":24,"name":25,"@type":21,"position":26},"https://docshare.wps.com/document/","Document",2,{"item":28,"name":29,"@type":21,"position":30},"https://docshare.wps.com/document/research-report/","Research & Report",3,{"item":32,"name":10,"@type":21,"position":33},"https://docshare.wps.com/document/on-the-utility-and-factual-reliability-of-pruned-mixture-of-experts-models-in-the-biomedical-domain/327295/",4,{"url":32,"name":10,"@type":35,"image":36,"author":41,"headline":10,"publisher":44,"fileFormat":47,"inLanguage":8,"description":12,"dateModified":48,"datePublished":49,"encodingFormat":47,"isAccessibleForFree":50,"interactionStatistic":51},"DigitalDocument",{"url":37,"@type":38,"width":39,"height":40},"https://docshare.wps.com/thumbnails/on-the-utility-and-factual-reliability-of-pruned-mixture-of-experts-models-in-the-biomedical-domain/327295.png","ImageObject",300,407,{"name":42,"@type":43},"Olivia Brown","Person",{"url":19,"name":45,"@type":46},"DocShare","Organization","application/pdf","2026-10-24","2026-09-21",true,{"@type":52,"interactionType":53,"userInteractionCount":55},"InteractionCounter",{"@type":54},"ViewAction",13,{"@type":57,"mainEntity":58},"FAQPage",[59,65,69],{"name":60,"@type":61,"acceptedAnswer":62},"Why can expert pruning affect factual reliability in MoE models?","Question",{"text":63,"@type":64},"Expert pruning removes entire experts, which changes the model architecture and can force reliance on fallback experts. These alternatives may stay fluent while introducing subtle factual inaccuracies.","Answer",{"name":66,"@type":61,"acceptedAnswer":67},"What does the paper find about moderate pruning in the biomedical domain?",{"text":68,"@type":64},"Moderate pruning preserves in-domain utility without an immediate decline in reliability. However, hallucination risks rise when pruning becomes extreme.",{"name":70,"@type":61,"acceptedAnswer":71},"How do utility and reliability change under domain shift?",{"text":72,"@type":64},"When moving from the biomedical domain to a general domain, both utility and reliability degrade rapidly.","https://schema.org",{"og:url":32,"og:type":75,"og:title":10,"og:site_name":45,"og:description":12},"article",{"robots":77,"canonical":32},"index,follow",{"doc_id":79,"site_id":7},327295,1790536065,{"code":4,"msg":82,"data":83},"success",[84,88,92,96,101,106,111,115,120,123,127],{"id":22,"doc_module":4,"doc_module_name":25,"category_name":85,"show_sort_weight":86,"slug":87},"Story & Novel",90,"story-novel",{"id":26,"doc_module":4,"doc_module_name":25,"category_name":89,"show_sort_weight":90,"slug":91},"Literature",80,"literature",{"id":33,"doc_module":4,"doc_module_name":25,"category_name":93,"show_sort_weight":94,"slug":95},"Exam",70,"exam",{"id":97,"doc_module":4,"doc_module_name":25,"category_name":98,"show_sort_weight":99,"slug":100},5,"Comic",60,"comic",{"id":102,"doc_module":4,"doc_module_name":25,"category_name":103,"show_sort_weight":104,"slug":105},6,"Technology",50,"technology",{"id":107,"doc_module":4,"doc_module_name":25,"category_name":108,"show_sort_weight":109,"slug":110},7,"Healthcare",40,"healthcare",{"id":112,"doc_module":4,"doc_module_name":25,"category_name":29,"show_sort_weight":113,"slug":114},8,30,"research-report",{"id":116,"doc_module":4,"doc_module_name":25,"category_name":117,"show_sort_weight":118,"slug":119},9,"Religion & Spirituality",20,"religion-spirituality",{"id":118,"doc_module":4,"doc_module_name":25,"category_name":121,"show_sort_weight":118,"slug":122},"World Cup","world-cup",{"id":124,"doc_module":4,"doc_module_name":25,"category_name":125,"show_sort_weight":124,"slug":126},10,"Lifestyle","lifestyle",{"id":128,"doc_module":4,"doc_module_name":25,"category_name":129,"show_sort_weight":97,"slug":130},19,"General","general",{"code":4,"msg":82,"data":132},{"doc_id":79,"user_id":133,"nickname":42,"user_avatar":134,"doc_module":4,"category_id":112,"category_name":29,"doc_title":10,"doc_description":12,"doc_content":135,"file_id":136,"file_url":137,"file_type":138,"file_size":139,"view_count":55,"is_deleted":4,"is_public":22,"is_downloadable":22,"audit_status":22,"page_count":140,"language":141,"language_code":8,"site_id":7,"html_lang":8,"table_of_contents":142,"faqs":143,"seo_title":144,"seo_description":12,"update_tm":145,"read_time":99,"preview_page_count":4},16904993612988,"https://ap-avatar.wpscdn.com/davatar_a8503ba1806abce46bf441b54a3ca4cd","On the Utility and Factual Reliability of  \nPruned Mixture-of-Experts Models in the Biomedical Domain  \nAtsuki Yamaguchi 1,2 Szymon Palucha2 Léo Bijar2 Aline Villavicencio 1,3,4 Nikolaos Aletras 1  \n1University of Sheffield, United Kingdom 2AstraZeneca  \n3University of Exeter, United Kingdom 4Federal University of Rio Grande do Norte, Brazil {ayamaguchi1,a.villavicencio, [n.aletras}@sheffield.ac.uk](n.aletras}@sheffield.ac.uk)  \narXiv :2607 .0 1444v 1 [ cs .LG] 1 Jul 2026  \nAbstract  \nMixture-of-Experts (MoE) models offer inference speedups via selective activation but impose substantial memory requirements because the whole network must remain loaded. Structured expert pruning is a practical approach for reducing deployment costs in resource-constrained settings. However, prior studies primarily evaluate benchmark utility, leaving the effect of pruning on factual reliability underexplored, particularly in high-stakes domains such as biomedicine.  \nIn this paper, we investigate how domainspecific expert pruning affects both utility and reliability. We assess four MoE models, six pruning methods, and multiple pruning ratios across generation and classification tasks under in-domain (biomedical) and cross-domain settings. Results reveal that moderate pruning preserves in-domain utility without immediate reliability decline, although hallucination risks increase at extreme pruning ratios. When shifting to the general domain, both utility and reliability degrade rapidly. These findings indicate that safe compression depends heavily on the task and domain. Evaluating pruned MoE models solely on utility is inadequate for high-stakes deployment without reliability assessment.1  \n1 Introduction  \nModern large language models (LLMs) such as Qwen3.6 (Qwen Team, 2026), GPT-OSS (OpenAI et al., 2025), and Nemotron3 (NVIDIA et al., 2025) follow a Mixture-of-Experts (MoE) architecture. During the forward pass, MoE models activate only a subset of the network by routing each token through specialized subnetworks called experts (Du et al., 2022 ; Cai et al., 2025) . They achieve strong performance while offering substantial inference speedups. However, this efficiency  \n1Our code is available at [https://github.com/](https://github.com/)[ ](https://github.com/)gucci-j/moe-pruning-reliability.  \nEutrophic electrotherapy was more e4ective than a uniform 10 Hz electrotherapy ... uniform 10 Hz electrotherapy ignored the spike train information, which was the signal inducing rapid... adaptation.  \nFigure 1: An example of hallucination in biomedical text summarization, where the text highlighted in red represents a term that inverts the original meaning of the source while it is still plausible.  \ndoes not eliminate the memory overhead during deployment. At inference, all experts must remain loaded in memory, which results in substantially larger memory footprints than those of dense models with comparable active parameter counts.  \nA popular approach to mitigating this constraint is expert pruning, which eliminates redundant experts based on an informativeness (i.e., saliency) criterion estimated from a small calibration dataset (Chen et al., 2022 ; Muzio et al., 2024 ; Lu et al., 2024, inter alia) . Among these approaches, domain-specific expert pruning has been proposed to tailor the compressed model for a particular field (Dong et al., 2025), such as biomedicine. However, previous studies primarily evaluate pruning methods on downstream benchmark performance, or utility. Consequently, they overlook the reliability of the resulting compressed models. This includes factual consistency, faithfulness, and hallucination prevention (Ji et al., 2023 ; Pal et al., 2023) . This oversight poses serious risks particularly in high-stakes domains such as biomedicine, where factual errors can lead to critical real-world failures (Weidinger et al., 2022 ; Moor et al., 2023) .  \nFurthermore, benchmark utility does not always  \nalign with factual reliability. Ch","cbCaijIbi1ujzV58","https://ap.wps.com/l/cbCaijIbi1ujzV58","pdf",1019489,24,"English","# Abstract\n# Introduction\n# Related Work","[{\"question\":\"Why can expert pruning affect factual reliability in MoE models?\",\"answer\":\"Expert pruning removes entire experts, which changes the model architecture and can force reliance on fallback experts. These alternatives may stay fluent while introducing subtle factual inaccuracies.\"},{\"question\":\"What does the paper find about moderate pruning in the biomedical domain?\",\"answer\":\"Moderate pruning preserves in-domain utility without an immediate decline in reliability. However, hallucination risks rise when pruning becomes extreme.\"},{\"question\":\"How do utility and reliability change under domain shift?\",\"answer\":\"When moving from the biomedical domain to a general domain, both utility and reliability degrade rapidly.\"}]","On the Utility and Factual Reliability of Pruned Mixture-of-Experts Models in the Biomedical Domain | PDF",1789976930]