[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-seo-138563-105":3,"doc-detail-138563-en":81,"detail-sidebar-cat-0-en-105":98},{"code":4,"msg":5,"data":6},0,"ok",{"site_id":7,"language":8,"slug":9,"title":10,"keywords":11,"description":12,"schema_data":13,"social_meta":74,"head_meta":76,"extra_data":78,"updated_unix":80},105,"en","cale-concept-aligned-embeddings-for-both-within-lemma-and-inter-lemma-sense-differentiation","CALE : Concept-Aligned Embeddings for Both Within-Lemma and Inter-Lemma Sense Differentiation","","Lexical semantics studies word senses across contexts and the semantic relations between meanings of different words. Contextualized Language Models provide context-sensitive representations for lexical meaning, but prior work focused on Word-in-Context compares occurrences of the same lemma, limiting inter-word information. This paper proposes Concept Differentiation and introduces a SemCor-derived dataset, then fine-tunes multiple models to produce Concept-Aligned Embeddings (CALE). Experiments across lexical semantic tasks show strong multi-purpose performance and embedding space reorganization.",{"@graph":14,"@context":73},[15,34,56],{"@type":16,"itemListElement":17},"BreadcrumbList",[18,23,27,31],{"item":19,"name":20,"@type":21,"position":22},"https://docshare.wps.com","Home","ListItem",1,{"item":24,"name":25,"@type":21,"position":26},"https://docshare.wps.com/document/","Document",2,{"item":28,"name":29,"@type":21,"position":30},"https://docshare.wps.com/document/research-report/","Research & Report",3,{"item":32,"name":10,"@type":21,"position":33},"https://docshare.wps.com/document/cale-concept-aligned-embeddings-for-both-within-lemma-and-inter-lemma-sense-differentiation/138563/",4,{"url":32,"name":10,"@type":35,"image":36,"author":41,"headline":10,"publisher":44,"fileFormat":47,"inLanguage":8,"description":12,"dateModified":48,"datePublished":49,"encodingFormat":47,"isAccessibleForFree":50,"interactionStatistic":51},"DigitalDocument",{"url":37,"@type":38,"width":39,"height":40},"https://docshare.wps.com/thumbnails/cale-concept-aligned-embeddings-for-both-within-lemma-and-inter-lemma-sense-differentiation/138563.png","ImageObject",300,407,{"name":42,"@type":43},"Eden","Person",{"url":19,"name":45,"@type":46},"DocShare","Organization","application/pdf","2026-09-20","2026-08-23",true,{"@type":52,"interactionType":53,"userInteractionCount":55},"InteractionCounter",{"@type":54},"ViewAction",7,{"@type":57,"mainEntity":58},"FAQPage",[59,65,69],{"name":60,"@type":61,"acceptedAnswer":62},"What limitation of Word-in-Context motivates Concept Differentiation?","Question",{"text":63,"@type":64},"Word-in-Context traditionally compares occurrences of the same lemma, so it captures within-word sense variation but largely ignores inter-word semantic relations. Concept Differentiation extends the comparison to both same-lemma and cross-lemma pairs.","Answer",{"name":66,"@type":61,"acceptedAnswer":67},"How is Concept Differentiation defined in the paper?",{"text":68,"@type":64},"Given two word occurrences, the task determines whether they instantiate the same semantic concept. It is formulated as a binary classification over Concept or Frame Induction.",{"name":70,"@type":61,"acceptedAnswer":71},"What are CALE (Concept-Aligned Embeddings) and what do the experiments show?",{"text":72,"@type":64},"CALE is a family of token-level models fine-tuned for Concept Differentiation using the SPCD dataset. The results show strong performance across multiple lexical semantic tasks and indicate that fine-tuning shifts embedding organization from lemma-centric to concept-centric representations.","https://schema.org",{"og:url":32,"og:type":75,"og:title":10,"og:site_name":45,"og:description":12},"article",{"robots":77,"canonical":32},"index,follow",{"doc_id":79,"site_id":7},138563,1787483879,{"code":4,"msg":82,"data":83},"success",{"doc_id":79,"user_id":84,"nickname":42,"user_avatar":85,"doc_module":4,"category_id":86,"category_name":29,"doc_title":10,"doc_description":12,"doc_content":87,"file_id":88,"file_url":89,"file_type":90,"file_size":91,"view_count":55,"is_deleted":4,"is_public":22,"is_downloadable":22,"audit_status":22,"page_count":92,"language":93,"language_code":8,"site_id":7,"html_lang":8,"table_of_contents":94,"faqs":95,"seo_title":96,"seo_description":12,"update_tm":80,"read_time":97},1374391974468,"https://ap-avatar.wpscdn.com/davatar_29158cc5080c5b710cf443261637dec0",8,"CALE : Concept-Aligned Embeddings for Both Within-Lemma and Inter-Lemma Sense Differentiation  \nBastien Liétard1 and Gabriel Loiseau1,2 ,  \n1University of Lille, Inria, CNRS, Centrale Lille, UMR 9189-CRIStAL, F-59000 Lille, France  \n2Hornetsecurity, Hem, France  \n[first_name.last_name@inria.fr](first_name.last_name@inria.fr)  \nAuthors contributed equally.  \nAbstract  \nLexical semantics is concerned with both the multiple senses a word can adopt in different contexts, and the semantic relations that exist between meanings of different words. To investigate them, Contextualized Language Models are a valuable tool that provides contextsensitive representations that can be used to investigate lexical meaning. Recent works like XL-LEXEME have leveraged the task of Wordin-Context to fine-tune them to get more semantically accurate representations, but Word-inContext only compares occurrences ofthe same lemma, limiting the range of captured information. In this paper, we propose an extension, Concept Differentiation, to include inter-words scenarios. We provide a dataset for this task, derived from SemCor data. Then we fine-tune several representation models on this dataset.  \nWe call these models Concept-Aligned Embeddings (CALE) . By challenging our models and other models on various lexical semantic tasks, we demonstrate that the proposed models provide efficient multi-purpose representations of lexical meaning that reach best performances in our experiments. We also show that CALE’s fine-tuning brings valuable changes to the spatial organization of embeddings.  \n1 Introduction  \nResearch in computational lexical semantics has relied on contextualized embeddings to study word meaning in context (Neidlein et al., 2020 ; Chronisand Erk, 2020 ; Apidianaki and Garí Soler, 2021 ; Yu and Xu, 2023 ; Li et al., 2024), with applications extending beyond traditional tasks, such as in debate modeling (Garí Soler et al., 2023) and political discourse analysis (Boholm et al., 2024) . However, most approaches use pre-trained models like BERT (Devlin et al., 2019) or XLM-R (Conneau et al., 2020) without fine-tuning specifically for lexical semantics, due to limited annotated data.  \nWhile several models are fine-tuned for the Word-in-Context (WiC) task (Pilehvar and  \nCamacho-Collados, 2019 ; Liu et al., 2021 ; Cassotti et al., 2023 ; Mosolova et al., 2024), WiC in its traditional definition only captures within-word meaning variation (i.e. the word’s senses) and ignores inter-word semantic relations. Consequently, models trained on WiC may struggle to capture the broader structure of lexical meaning.  \nTo reach a higher perspective, the focus must shift from word senses to semantic concepts. Throughout this paper, we distinguish senses and concepts as follows: a word sense is a conventionalized way to use a particular lemma in relevant contexts, it characterizes the use of a specific word for an intended meaning; concepts are mental representations of categories of objects, events, acts and ideas, and we use words to refer to them (Murphy, 2002) . In context, the meaning of a word is the concept it refers to, and a word sense is a pointer to a concept. Our concepts are equivalent to Wikipedia entries, or WordNet synsets (Miller, 1995) as made in Liétard et al. (2024) .  \nIn this paper, we are interested in the use of contextualized models to obtain multi-purpose (as opposed to “task-specific”) vector representation of word meaning. Word occurrences that instantiate the same concept in respective contexts should have similar representations, while occurrences of words that refer to different concepts should have dissimilar embeddings. A model with this desired property would be useful in studies of the mapping between word forms and concepts, like Haspelmath (2023) for instance, or in any computational lexical semantic applications mentioned above.  \nWe focus on synonymy (different words having the same meaning, instantiating the same concept) a","cbCaiaYSC51I4gBy","https://ap.wps.com/l/cbCaiaYSC51I4gBy","pdf",454004,15,"English","# Abstract\n# Introduction\n## From Word-in-Context to Concept Differentiation\n## Concepts vs. senses and desired embedding properties\n## Task and dataset SPCD\n## CALE model and evaluations","[{\"question\":\"What limitation of Word-in-Context motivates Concept Differentiation?\",\"answer\":\"Word-in-Context traditionally compares occurrences of the same lemma, so it captures within-word sense variation but largely ignores inter-word semantic relations. Concept Differentiation extends the comparison to both same-lemma and cross-lemma pairs.\"},{\"question\":\"How is Concept Differentiation defined in the paper?\",\"answer\":\"Given two word occurrences, the task determines whether they instantiate the same semantic concept. It is formulated as a binary classification over Concept or Frame Induction.\"},{\"question\":\"What are CALE (Concept-Aligned Embeddings) and what do the experiments show?\",\"answer\":\"CALE is a family of token-level models fine-tuned for Concept Differentiation using the SPCD dataset. The results show strong performance across multiple lexical semantic tasks and indicate that fine-tuning shifts embedding organization from lemma-centric to concept-centric representations.\"}]","CALE : Concept-Aligned Embeddings for Both Within-Lemma and Inter-Lemma Sense Differentiation | PDF",38,{"code":4,"msg":82,"data":99},[100,104,108,112,117,122,126,129,134,137,141],{"id":22,"doc_module":4,"doc_module_name":25,"category_name":101,"show_sort_weight":102,"slug":103},"Story & Novel",90,"story-novel",{"id":26,"doc_module":4,"doc_module_name":25,"category_name":105,"show_sort_weight":106,"slug":107},"Literature",80,"literature",{"id":33,"doc_module":4,"doc_module_name":25,"category_name":109,"show_sort_weight":110,"slug":111},"Exam",70,"exam",{"id":113,"doc_module":4,"doc_module_name":25,"category_name":114,"show_sort_weight":115,"slug":116},5,"Comic",60,"comic",{"id":118,"doc_module":4,"doc_module_name":25,"category_name":119,"show_sort_weight":120,"slug":121},6,"Technology",50,"technology",{"id":55,"doc_module":4,"doc_module_name":25,"category_name":123,"show_sort_weight":124,"slug":125},"Healthcare",40,"healthcare",{"id":86,"doc_module":4,"doc_module_name":25,"category_name":29,"show_sort_weight":127,"slug":128},30,"research-report",{"id":130,"doc_module":4,"doc_module_name":25,"category_name":131,"show_sort_weight":132,"slug":133},9,"Religion & Spirituality",20,"religion-spirituality",{"id":132,"doc_module":4,"doc_module_name":25,"category_name":135,"show_sort_weight":132,"slug":136},"World Cup","world-cup",{"id":138,"doc_module":4,"doc_module_name":25,"category_name":139,"show_sort_weight":138,"slug":140},10,"Lifestyle","lifestyle",{"id":142,"doc_module":4,"doc_module_name":25,"category_name":143,"show_sort_weight":113,"slug":144},19,"General","general"]