[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-83376-en":3,"doc-seo-83376-105":29,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":13,"seo_description":14,"update_tm":27,"read_time":28},83376,1099514068365,"Aurelia","https://ap-avatar.wpscdn.com/avatar/10000253d8d9f28188e?_k=1776742907772140068",8,"Research & Report","Towards Mechanistically Understanding Why Memorized Knowledge Fails to Generalize in Large Language Model Finetuning","Fine-tuning large language models to inject new knowledge often triggers a critical mismatch: models memorize fresh facts quickly, yet fail to use them in downstream reasoning. The work formalizes this behavior as the Knowing–Using Gap, capturing both an accuracy gap and a temporal lag between memorization and generalization. Using fine-tuned LLMs with unseen knowledge, it introduces self-patching to map internal knowledge permeation dynamics. Results support a knowledge-circuit misalignment hypothesis and a heuristic recovery strategy recovering 58–75% of oracle headroom, with cross-domain robustness checks.","arXiv :2607 .08393v 1 [ cs .AI] 9 Jul 2026  \nTowards Mechanistically Understanding Why Memorized Knowledge Fails to Generalize in Large Language Model Finetuning  \nLu Dai2,1 Ziyang Rao1 Yili Wang1 Hanqing Wang1 Hao Liu1,2 Hui Xiong1,2  \n1HKUST(GZ) 2HKUST  \n[ldaiae@connect.ust.hk {liuh](ldaiae@connect.ust.hk {liuh) ,[xionghui}@ust.hk](xionghui}@ust.hk)  \nAbstract  \nFine-tuning LLMs to inject new knowledge faces a critical challenge: LLMs can quickly memorize new facts, yet fail to use them for downstream reasoning tasks. We formalize this failure as the Knowing–Using Gap, characterized by an accuracy gap and a temporal lag between memorization and generalization.  \nTo understand this phenomenon, we fine-tune LLMs with unseen knowledge and monitor the spatial permeation dynamics of the knowledge internally using a novel intervention technique called self-patching. Self-patching identifies activation locations where relocating representations substantially improves failed generalization cases. These results are consistent with a knowledge-circuit misalignment hypothesis: memorized representations can exist internally but may not be routed to computation-effective layers. To demonstrate the practicality of this diagnostic finding, we design a simple heuristic strategy which recovers 58–75% of the oracle headroom in generalization failure. Experiments are done cross-domain for the robustness of this finding. Code and data are open at [https://anonymous.4open.science/r/Mem2Gen-71FF](https://anonymous.4open.science/r/Mem2Gen-71FF).  \n1 Introduction  \nLarge language models (LLMs) excel at varieties of tasks but face significant challenges in adapting to unseen information, necessitating effective methods for post-training knowledge updates. While there are approaches like retrieval-augmented generation (RAG) and knowledge editing Meng et al., Gupta et al. [2024], fine-tuning remains a fundamental paradigm for knowledge updating, as it not only operates on parametric memory end-to-end but also injects knowledge in a way that can be reused by the model’s existing reasoning capabilities.  \nDespite sufficient capacity to fit new data Morris et al. [2025], Allen-Zhu and Li, LLMs exhibit a“remembering but not using” failure Ovadia et al. [2024], Soudani et al. [2024], Zhong et al. [2023], Cohen et al. [2024], Berglund et [al. as](al. as) shown in Figure 1: models can memorize new facts (e.g.,“Sydney is located in [Entity]”) but fail to reliably use them in downstream reasoning (e.g.,“The capital of the country Sydney located is . . .”) Zhong et al. [2023], Cohen et al. [2024], Yao et al.[2025], creating a gap between simple memorization and flexible generalization.  \nWe term this phenomenon the Knowing–Using Gap, characterized by two distinct disparities: 1) an accuracy gap, where generalization accuracy remains significantly lower than memorization; and 2) a temporal lag, where generalization emerges significantly later after remembering.  \nThis observation raises fundamental research questions on the mechanics of fine-tuning: Once a fact is memorized, when and why does it become accessible to the model’s existing reasoning circuits?  \nPreprint.  \n(b) Conceptual illustration: LLM soon learn to memorize two new atomic facts but fail to generalize to reasoning questions  \n(a) Knowing–Using Gap: In a real fine-tuning dynamics above, a significant accuracy and temporal gap is shown between memorization and chaining.  \n(c) Saturation Epochs: Finetuning 1000 cases, the mean and std of epochs where memorization and generalization happens  \nFigure 1: Illustration of the Knowing–Using Gap.  \nTo address these questions, we conduct a fine-grained analysis of the training dynamics during knowledge injection. We construct datasets from two real-world domain knowledge bases and eliminate overlap with pretraining. We define two types of reasoning QA tasks to evaluate how LLMs generalize the learned knowledge: chaining task requires resolving a bridge ent","cbCaivik9gDzfFjP","https://ap.wps.com/l/cbCaivik9gDzfFjP","pdf",9421375,1,26,"English","en",105,"# Abstract\n# Introduction\n## Knowing–Using Gap\n## Self-patching and spatial permeation mapping\n## Knowledge–circuit misalignment hypothesis","[{\"question\":\"What problem does the paper focus on in large language model fine-tuning?\",\"answer\":\"It focuses on why fine-tuned models can memorize new facts yet fail to generalize those facts to downstream reasoning tasks.\"},{\"question\":\"How does the paper define the Knowing–Using Gap?\",\"answer\":\"It defines the Knowing–Using Gap as an accuracy gap and a temporal lag between when facts are memorized and when they become usable for generalization.\"},{\"question\":\"What is self-patching, and what does it help reveal?\",\"answer\":\"Self-patching is an intervention technique that relocates internal hidden representations from a source run into a target run to measure changes in correct-answer probability. It reveals which layers and positions contain representations that can enable generalization after memorization.\"}]",1784187081,66,{"code":4,"msg":30,"data":31},"ok",{"site_id":24,"language":23,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":27},"towards-mechanistically-understanding-why-memorized-knowledge-fails-to-generalize-in-large-language-model-finetuning","",{"@graph":35,"@context":85},[36,53,68],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/towards-mechanistically-understanding-why-memorized-knowledge-fails-to-generalize-in-large-language-model-finetuning/83376/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-17","2026-07-16",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does the paper focus on in large language model fine-tuning?","Question",{"text":75,"@type":76},"It focuses on why fine-tuned models can memorize new facts yet fail to generalize those facts to downstream reasoning tasks.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does the paper define the Knowing–Using Gap?",{"text":80,"@type":76},"It defines the Knowing–Using Gap as an accuracy gap and a temporal lag between when facts are memorized and when they become usable for generalization.",{"name":82,"@type":73,"acceptedAnswer":83},"What is self-patching, and what does it help reveal?",{"text":84,"@type":76},"Self-patching is an intervention technique that relocates internal hidden representations from a source run into a target run to measure changes in correct-answer probability. It reveals which layers and positions contain representations that can enable generalization after memorization.","https://schema.org",{"og:url":51,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":51},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":45,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":45,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":45,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":45,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":45,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":45,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":45,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]