[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"detail-sidebar-cat-0-en-105":3,"doc-seo-327493-105":59,"doc-detail-327493-en":130},{"code":4,"msg":5,"data":6},0,"success",[7,13,18,23,28,33,38,43,48,51,55],{"id":8,"doc_module":4,"doc_module_name":9,"category_name":10,"show_sort_weight":11,"slug":12},1,"Document","Story & Novel",90,"story-novel",{"id":14,"doc_module":4,"doc_module_name":9,"category_name":15,"show_sort_weight":16,"slug":17},2,"Literature",80,"literature",{"id":19,"doc_module":4,"doc_module_name":9,"category_name":20,"show_sort_weight":21,"slug":22},4,"Exam",70,"exam",{"id":24,"doc_module":4,"doc_module_name":9,"category_name":25,"show_sort_weight":26,"slug":27},5,"Comic",60,"comic",{"id":29,"doc_module":4,"doc_module_name":9,"category_name":30,"show_sort_weight":31,"slug":32},6,"Technology",50,"technology",{"id":34,"doc_module":4,"doc_module_name":9,"category_name":35,"show_sort_weight":36,"slug":37},7,"Healthcare",40,"healthcare",{"id":39,"doc_module":4,"doc_module_name":9,"category_name":40,"show_sort_weight":41,"slug":42},8,"Research & Report",30,"research-report",{"id":44,"doc_module":4,"doc_module_name":9,"category_name":45,"show_sort_weight":46,"slug":47},9,"Religion & Spirituality",20,"religion-spirituality",{"id":46,"doc_module":4,"doc_module_name":9,"category_name":49,"show_sort_weight":46,"slug":50},"World Cup","world-cup",{"id":52,"doc_module":4,"doc_module_name":9,"category_name":53,"show_sort_weight":52,"slug":54},10,"Lifestyle","lifestyle",{"id":56,"doc_module":4,"doc_module_name":9,"category_name":57,"show_sort_weight":24,"slug":58},19,"General","general",{"code":4,"msg":60,"data":61},"ok",{"site_id":62,"language":63,"slug":64,"title":65,"keywords":66,"description":67,"schema_data":68,"social_meta":123,"head_meta":125,"extra_data":127,"updated_unix":129},105,"en","neuron-aware-data-selection-for-annotation-free-llm-self-distillation-arxiv","Neuron-Aware Data Selection for Annotation-Free LLM Self-Distillation - arXiv","","Post-training large language models without real-world interaction feedback or human-labeled supervision is difficult, especially in specialized domains where expert annotations are expensive. Annotation-free self-evolution methods generate pseudo-labels from model outputs, but SFT/GRPO variants can degrade out-of-domain performance, and reward-based on-policy RL can inflate calibration error. This paper introduces NEURON-OPSD, an annotation-free, data-centric self-distillation framework using internal neuron activations for training-data selection and teacher context construction, improving in-domain performance while preserving cross-domain generalization and mitigating calibration collapse.",{"@graph":69,"@context":122},[70,84,105],{"@type":71,"itemListElement":72},"BreadcrumbList",[73,77,79,82],{"item":74,"name":75,"@type":76,"position":8},"https://docshare.wps.com","Home","ListItem",{"item":78,"name":9,"@type":76,"position":14},"https://docshare.wps.com/document/",{"item":80,"name":40,"@type":76,"position":81},"https://docshare.wps.com/document/research-report/",3,{"item":83,"name":65,"@type":76,"position":19},"https://docshare.wps.com/document/neuron-aware-data-selection-for-annotation-free-llm-self-distillation-arxiv/327493/",{"url":83,"name":65,"@type":85,"image":86,"author":91,"headline":65,"publisher":94,"fileFormat":97,"inLanguage":63,"description":67,"dateModified":98,"datePublished":99,"encodingFormat":97,"isAccessibleForFree":100,"interactionStatistic":101},"DigitalDocument",{"url":87,"@type":88,"width":89,"height":90},"https://docshare.wps.com/thumbnails/neuron-aware-data-selection-for-annotation-free-llm-self-distillation-arxiv/327493.png","ImageObject",300,407,{"name":92,"@type":93},"Hazel","Person",{"url":74,"name":95,"@type":96},"DocShare","Organization","application/pdf","2026-10-24","2026-09-21",true,{"@type":102,"interactionType":103,"userInteractionCount":56},"InteractionCounter",{"@type":104},"ViewAction",{"@type":106,"mainEntity":107},"FAQPage",[108,114,118],{"name":109,"@type":110,"acceptedAnswer":111},"What problem does the paper address in specialized-domain adaptation of LLMs?","Question",{"text":112,"@type":113},"Adapting LLMs to specialized domains is hard due to the scarcity of human expert annotations, which limits standard supervised fine-tuning and related approaches.","Answer",{"name":115,"@type":110,"acceptedAnswer":116},"How does NEURON-OPSD differ from prior annotation-free self-evolution methods?",{"text":117,"@type":113},"NEURON-OPSD is a data-centric, annotation-free on-policy self-distillation framework that uses internal neuron activations to guide both training-data selection and teacher context construction.",{"name":119,"@type":110,"acceptedAnswer":120},"What mechanisms does the framework use to build training data and teacher prompts?",{"text":121,"@type":113},"It uses two neuron-based components: Neuron Consensus for reliability of candidate samples via activation statistics, and a teacher context construction method based on neuron-guided cues to induce the teacher distribution.","https://schema.org",{"og:url":83,"og:type":124,"og:title":65,"og:site_name":95,"og:description":67},"article",{"robots":126,"canonical":83},"index,follow",{"doc_id":128,"site_id":62},327493,1790378452,{"code":4,"msg":5,"data":131},{"doc_id":128,"user_id":132,"nickname":92,"user_avatar":133,"doc_module":4,"category_id":39,"category_name":40,"doc_title":65,"doc_description":67,"doc_content":134,"file_id":135,"file_url":136,"file_type":137,"file_size":138,"view_count":56,"is_deleted":4,"is_public":8,"is_downloadable":8,"audit_status":8,"page_count":139,"language":140,"language_code":63,"site_id":62,"html_lang":63,"table_of_contents":141,"faqs":142,"seo_title":143,"seo_description":67,"update_tm":144,"read_time":36,"preview_page_count":4},137441390410,"https://ap-avatar.wpscdn.com/avatar/2000252f4ab5702993?_k=1776741390130283984","arXiv :2607 .02460v 1 [ cs .LG] 2 Jul 2026  \nNeuron-Aware Data Selection for Annotation-Free  \nLLM Self-Distillation  \nZhuowei Chen Xiang Lorraine Li  \nUniversity of Pittsburgh, United States {zhuowei.chen, [xianglli}@pitt.edu](xianglli}@pitt.edu)  \nAbstract  \nPost-training large language models (LLMs) without real-world interaction feedback or human-labeled supervision remains challenging, particularly in specialized domains where expert annotations are costly to obtain. Recent annotation-free selfevolution methods address this by using the model’s own outputs as supervision signals, constructing a teacher via additional context and aggregating predictions across multiple rollouts through majority voting to produce pseudo-labels. However, these approaches are not without drawbacks: SFT-and GRPO-based variants suffer out-of-domain performance degradation, while reward-based on-policy RL inflates calibration error. In this paper, we propose NEURON ON-POLICY SELFDISTILLATION (NEURON-OPSD), a data-centric framework for annotation-free self-distillation that leverages internal neuron activations to guide both trainingdata selection and teacher context construction. The model is then trained via on-policy distillation from the teacher distribution, requiring no ground-truth labels at any stage. Across specialized-domain benchmarks, NEURON-OPSD improvesin-domain task performance while preserving cross-domain generalization and mitigating calibration collapse over prior annotation-free baselines. This framework is particularly relevant to settings where online interaction or external supervision is costly or infeasible, and is conceptually distinct from offline RL approaches that rely on logged, reward-labeled trajectories.  \nFigure 1: Overview of the Proposed Neuron-OPSD.  \nAccepted at ICML 2026 Workshop on Decision-Making from Offline Datasets to Online Adaptation: Black-Box Optimization to Reinforcement Learning.  \n1 Introduction  \nRecent advances in Large language models (LLMs) have demonstrated remarkable performances in general tasks, however, adapting them to highly specialized domains such as education, law, or STEM subjects, remains difficult, which mainly due to the scarcity of human expert annotations.  \nTo mitigate the scarcity of expert annotations, recent work has explored annotation-free self-training, where the model improves itself using only unlabeled data and signals derived from the model itself. SFT-based methods such as LMSI fine-tune the model on its own generated responses or rationales [Huang et al., 2023] . GRPO-based methods instead construct scalar rewards from the model’s own outputs. TTRL extracts pseudo-labels from majority voting over multiple rolloutsand optimizes them with the GRPO algorithm [Zuo et al., 2025], while Intuitor uses entropy-based confidence signals as rewards [Zhao et al., 2025b] . Despite their empirical successes, these annotationfree paradigms still face fundamental limitations. SFT-based self-training can suffer from catastrophic forgetting, especially for out-of domain tasks. GRPO-based optimization faces challenges such as vanishing gradients under low within-group reward variance and entropy collapse during prolonged training. More fundamentally, GRPO collapses each rollout into a scalar reward, yielding only trajectory-level supervision and offering no guidance on which part of the reasoning should be reinforced or revised.  \nOn-policy distillation (OPD) offers finer supervision by training the student model against a teacher model’s token-level predictive distribution rather than a hard final-answer reward. Such logit-level targets densify supervision along the generation trajectory and circumvent the learning collapse caused by low within-group reward variances [Song and Zheng, 2026] . However, OPD’s effectiveness relies on the quality of the teacher distribution, which is typically derived from stronger models, verifiers, or curated demonstrations. When such external signals","cbCairDsM0tM3ghM","https://ap.wps.com/l/cbCairDsM0tM3ghM","pdf",2015503,16,"English","# Abstract\n# Introduction\n## Background on annotation-free self-training\n## Limitations of SFT, GRPO, and on-policy RL\n## On-policy distillation as token-level supervision\n## Data selection and neuron-based signals","[{\"question\":\"What problem does the paper address in specialized-domain adaptation of LLMs?\",\"answer\":\"Adapting LLMs to specialized domains is hard due to the scarcity of human expert annotations, which limits standard supervised fine-tuning and related approaches.\"},{\"question\":\"How does NEURON-OPSD differ from prior annotation-free self-evolution methods?\",\"answer\":\"NEURON-OPSD is a data-centric, annotation-free on-policy self-distillation framework that uses internal neuron activations to guide both training-data selection and teacher context construction.\"},{\"question\":\"What mechanisms does the framework use to build training data and teacher prompts?\",\"answer\":\"It uses two neuron-based components: Neuron Consensus for reliability of candidate samples via activation statistics, and a teacher context construction method based on neuron-guided cues to induce the teacher distribution.\"}]","Neuron-Aware Data Selection for Annotation-Free LLM Self-Distillation - arXiv | PDF",1789977328]