[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-86370-en":3,"doc-seo-86370-105":30,"detail-sidebar-cat-0-en-105":92},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":21,"is_downloadable":21,"audit_status":21,"page_count":22,"language":23,"language_code":24,"site_id":25,"html_lang":24,"table_of_contents":26,"faqs":27,"seo_title":13,"seo_description":14,"update_tm":28,"read_time":29},86370,962075006959,"Anda","https://ap-avatar.wpscdn.com/avatar/e0002397efbe92a78e?_k=1776741047341049297",8,"Research & Report","PsPLUG: A Lightweight Plug-in for Balancing Personalization and Style in Customized LLMs","Personalized large language models are often required to obey explicit style instructions, but explicit control can interfere with the user-specific characteristics that personalization techniques aim to retain. This failure mode is identified as personalization collapse, where style constraints conflict with implicit user preferences. PsPLUG is proposed as a lightweight plug-in that learns a user-specific residual after removing the requested style. Experiments show improved preference preservation and precise inference-time control over the balance between personalization and style adherence.","Do Implicit Personalization and Explicit Styles Conflict? PsPLUG: A Lightweight Plug-in for Balancing Personalization and Style in  \nCustomized LLMs  \nYutong Song♠ * , Jiang Wu♣ , Shaofan Yuan♢ , Chengze Shen♢ , Jian Wang♢ , Yu Wang♢ , Nikhil Dutt♠ , Amir Rahmani♠♠University of California, Irvine ♣Independent Researcher ♢TikTok  \narXiv :2601 .06362v2 [ cs .AI] 13 Jul 2026  \nAbstract  \nPersonalized large language models are often expected to follow explicit style instructions, yet we find that such instructions can undermine the user-specific characteristics that personalization methods aim to preserve. We call this failure mode personalization collapse: explicit style control can conflict with implicit user preferences. To address this challenge, we propose PsPLUG, a lightweight plug-in that learns a user-specific residual after accounting for the requested style. PsPLUG also allows us to tune personalization strength at inference time. Our experiments show that explicit style instructions can diminish personalization in existing methods, whereas PsPLUG better preserves user preferences while providing precise control over the balance between personalization and style adherence.  \n1 Introduction  \nLarge language models (LLMs) are increasingly deployed in interactive settings where users expect systems not only to produce factually correct content, but also to align with their individual linguistic habits, preferences, and communicative styles (Tan and Jiang, 2023 ; Zhang et al., 2024) . This has sparked rapid progress in personalized generation, including (i) retrieval-based methods that fetch user histories into the context window (Salemi et al., 2024b ; Kumar et al., 2024 ; Mysore et al., 2024 ; Tang et al., 2024), (ii) peruser fine-tuning approaches such as user-specific LoRA or adapters (Hu et al., 2021 ; Houlsby et al., 2019 ; Tan et al., 2024a,b), and (iii) lightweight plug-in mechanisms that inject user embeddings or soft prompts (Liu et al., 2024 ; Li and Liang, 2021 ; Liu et al., 2022) . Together, these techniques have demonstrated that LLMs can adapt to a user given  \nThe code is available at [https://anonymous.4open](https://anonymous.4open). science/status/PsPLUG-038C  \nFigure 1: The style-constrained personalization challenge. While standard models capture implicit user personalization, existing methods suffer from severe personalization collapse under explicit style instructions.  \nenough data or context. (Chen et al., 2024, 2025b ; Zhang et al., 2025a) Despite this progress, a critical vulnerability in current personalization pipelines remains largely overlooked. Existing methods typically inject user-related signals without theoretically clarifying what constitutes the core personalized signal, or how it relates to the neutral behavior of the base model under the same inputs (Shenfeld et al., 2025 ; Kim et al., 2025) . Concurrently, modern NLP applications increasingly operate under explicit system instructions, such as strict stylistic or tonal guidance (e.g.,“respond formally”,“use a concise tone”) (Zhang et al., 2023 ; Liang et al., 2024 ; Shanahan et al., 2023) . We empirically observe that when such explicit constraints are introduced, existing personalization methods suffer from severe persona degradation. Strong system instructions tend to dominate the generation space, effectively overriding and collapsing diverse dimensions of user-specific traits. This reveals a fundamental challenge: style-constrained personalization, where a model must reliably balance explicit task directives with implicit user priors.  \nTo address this, we introduce a novel theoretical  \nperspective: modeling personalization as a distribu-  \ntional residual. Rather than learning absolute output likelihoods, we view the persona as the distinct deviation between two conditional distributions under the identical input: the user’s true linguistic distribution and the neutral distribution of a base LLM. A user-authored response natural","cbCaiorEjgxwPcpE","https://ap.wps.com/l/cbCaiorEjgxwPcpE","pdf",1513381,5,1,20,"English","en",105,"# Introduction\n## Personalization Collapse under Explicit Style Instructions\n## Residual View of Personalization\n## Style-Aware Preference Objective\n## PsPLUG Method and Inference-Time Control","[{\"question\":\"What is “personalization collapse” in customized LLMs?\",\"answer\":\"Personalization collapse is the failure mode where explicit style instructions override implicit user-specific preferences, causing user traits to degrade during generation.\"},{\"question\":\"How does PsPLUG preserve user personalization when style instructions are present?\",\"answer\":\"PsPLUG learns a user-specific residual after accounting for the requested style, isolating persona signals from instruction-dominant effects.\"},{\"question\":\"How can the trade-off between style adherence and personalization strength be controlled?\",\"answer\":\"PsPLUG introduces a unified inference-time scaling mechanism controlled by a coefficient (α), enabling dynamic adjustment without per-user fine-tuning.\"}]",1784211124,50,{"code":4,"msg":31,"data":32},"ok",{"site_id":25,"language":24,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":87,"head_meta":89,"extra_data":91,"updated_unix":28},"psplug-a-lightweight-plug-in-for-balancing-personalization-and-style-in-customized-llms","",{"@graph":36,"@context":86},[37,54,69],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":21},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/psplug-a-lightweight-plug-in-for-balancing-personalization-and-style-in-customized-llms/86370/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":24,"description":14,"dateModified":62,"datePublished":63,"encodingFormat":61,"isAccessibleForFree":64,"interactionStatistic":65},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-07-27","2026-07-16",true,{"@type":66,"interactionType":67,"userInteractionCount":20},"InteractionCounter",{"@type":68},"ViewAction",{"@type":70,"mainEntity":71},"FAQPage",[72,78,82],{"name":73,"@type":74,"acceptedAnswer":75},"What is “personalization collapse” in customized LLMs?","Question",{"text":76,"@type":77},"Personalization collapse is the failure mode where explicit style instructions override implicit user-specific preferences, causing user traits to degrade during generation.","Answer",{"name":79,"@type":74,"acceptedAnswer":80},"How does PsPLUG preserve user personalization when style instructions are present?",{"text":81,"@type":77},"PsPLUG learns a user-specific residual after accounting for the requested style, isolating persona signals from instruction-dominant effects.",{"name":83,"@type":74,"acceptedAnswer":84},"How can the trade-off between style adherence and personalization strength be controlled?",{"text":85,"@type":77},"PsPLUG introduces a unified inference-time scaling mechanism controlled by a coefficient (α), enabling dynamic adjustment without per-user fine-tuning.","https://schema.org",{"og:url":52,"og:type":88,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":90,"canonical":52},"index,follow",{"doc_id":7,"site_id":25},{"code":4,"msg":5,"data":93},[94,98,102,106,110,114,119,122,126,129,133],{"id":21,"doc_module":4,"doc_module_name":46,"category_name":95,"show_sort_weight":96,"slug":97},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":99,"show_sort_weight":100,"slug":101},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":103,"show_sort_weight":104,"slug":105},"Exam",70,"exam",{"id":20,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":29,"slug":113},6,"Technology","technology",{"id":115,"doc_module":4,"doc_module_name":46,"category_name":116,"show_sort_weight":117,"slug":118},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":46,"category_name":124,"show_sort_weight":22,"slug":125},9,"Religion & Spirituality","religion-spirituality",{"id":22,"doc_module":4,"doc_module_name":46,"category_name":127,"show_sort_weight":22,"slug":128},"World Cup","world-cup",{"id":130,"doc_module":4,"doc_module_name":46,"category_name":131,"show_sort_weight":130,"slug":132},10,"Lifestyle","lifestyle",{"id":134,"doc_module":4,"doc_module_name":46,"category_name":135,"show_sort_weight":20,"slug":136},19,"General","general"]