[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"detail-sidebar-cat-0-en-105":3,"doc-seo-267350-105":59,"doc-detail-267350-en":131},{"code":4,"msg":5,"data":6},0,"success",[7,13,18,23,28,33,38,43,48,51,55],{"id":8,"doc_module":4,"doc_module_name":9,"category_name":10,"show_sort_weight":11,"slug":12},1,"Document","Story & Novel",90,"story-novel",{"id":14,"doc_module":4,"doc_module_name":9,"category_name":15,"show_sort_weight":16,"slug":17},2,"Literature",80,"literature",{"id":19,"doc_module":4,"doc_module_name":9,"category_name":20,"show_sort_weight":21,"slug":22},4,"Exam",70,"exam",{"id":24,"doc_module":4,"doc_module_name":9,"category_name":25,"show_sort_weight":26,"slug":27},5,"Comic",60,"comic",{"id":29,"doc_module":4,"doc_module_name":9,"category_name":30,"show_sort_weight":31,"slug":32},6,"Technology",50,"technology",{"id":34,"doc_module":4,"doc_module_name":9,"category_name":35,"show_sort_weight":36,"slug":37},7,"Healthcare",40,"healthcare",{"id":39,"doc_module":4,"doc_module_name":9,"category_name":40,"show_sort_weight":41,"slug":42},8,"Research & Report",30,"research-report",{"id":44,"doc_module":4,"doc_module_name":9,"category_name":45,"show_sort_weight":46,"slug":47},9,"Religion & Spirituality",20,"religion-spirituality",{"id":46,"doc_module":4,"doc_module_name":9,"category_name":49,"show_sort_weight":46,"slug":50},"World Cup","world-cup",{"id":52,"doc_module":4,"doc_module_name":9,"category_name":53,"show_sort_weight":52,"slug":54},10,"Lifestyle","lifestyle",{"id":56,"doc_module":4,"doc_module_name":9,"category_name":57,"show_sort_weight":24,"slug":58},19,"General","general",{"code":4,"msg":60,"data":61},"ok",{"site_id":62,"language":63,"slug":64,"title":65,"keywords":66,"description":67,"schema_data":68,"social_meta":124,"head_meta":126,"extra_data":128,"updated_unix":130},105,"en","bert-is-to-nlp-what-alexnet-is-to-cv-can-pre-trained-language-models-identify-analogies","BERT is to NLP what AlexNet is to CV - Can Pre-Trained Language Models Identify Analogies?","","Analogies underpin human commonsense reasoning and shape how knowledge is structured and language is understood. Yet identifying analogical proportions has received limited focus in the era of language models. This paper evaluates transformer-based pre-trained language models on an unsupervised analogy task using both educational benchmarks and widely used datasets. Results show partial analogy identification, with weak performance on abstract and complex relations and strong sensitivity to architecture and hyperparameters.",{"@graph":69,"@context":123},[70,84,106],{"@type":71,"itemListElement":72},"BreadcrumbList",[73,77,79,82],{"item":74,"name":75,"@type":76,"position":8},"https://docshare.wps.com","Home","ListItem",{"item":78,"name":9,"@type":76,"position":14},"https://docshare.wps.com/document/",{"item":80,"name":40,"@type":76,"position":81},"https://docshare.wps.com/document/research-report/",3,{"item":83,"name":65,"@type":76,"position":19},"https://docshare.wps.com/document/bert-is-to-nlp-what-alexnet-is-to-cv-can-pre-trained-language-models-identify-analogies/267350/",{"url":83,"name":65,"@type":85,"image":86,"author":91,"headline":65,"publisher":94,"fileFormat":97,"inLanguage":63,"description":67,"dateModified":98,"datePublished":99,"encodingFormat":97,"isAccessibleForFree":100,"interactionStatistic":101},"DigitalDocument",{"url":87,"@type":88,"width":89,"height":90},"https://docshare.wps.com/thumbnails/bert-is-to-nlp-what-alexnet-is-to-cv-can-pre-trained-language-models-identify-analogies/267350.png","ImageObject",300,407,{"name":92,"@type":93},"eBook King","Person",{"url":74,"name":95,"@type":96},"DocShare","Organization","application/pdf","2026-11-03","2026-09-14",true,{"@type":102,"interactionType":103,"userInteractionCount":105},"InteractionCounter",{"@type":104},"ViewAction",11,{"@type":107,"mainEntity":108},"FAQPage",[109,115,119],{"name":110,"@type":111,"acceptedAnswer":112},"What does the paper investigate about pre-trained language models?","Question",{"text":113,"@type":114},"It analyzes how well transformer-based pre-trained language models can identify word analogies in an unsupervised, zero-shot setting.","Answer",{"name":116,"@type":111,"acceptedAnswer":117},"What datasets and benchmarks are used for the analogy evaluation?",{"text":118,"@type":114},"The study uses benchmarks obtained from educational settings and also more commonly used public analogy datasets, including an example from the SAT dataset.",{"name":120,"@type":111,"acceptedAnswer":121},"How do different model architectures affect analogy identification?",{"text":122,"@type":114},"The results are highly sensitive to model architecture and hyperparameters, with the best performance reported for GPT-2 and RoBERTa, while BERT configurations do not outperform word embedding models.","https://schema.org",{"og:url":83,"og:type":125,"og:title":65,"og:site_name":95,"og:description":67},"article",{"robots":127,"canonical":83},"index,follow",{"doc_id":129,"site_id":62},267350,1789417514,{"code":4,"msg":5,"data":132},{"doc_id":129,"user_id":133,"nickname":92,"user_avatar":134,"doc_module":4,"category_id":39,"category_name":40,"doc_title":65,"doc_description":67,"doc_content":135,"file_id":136,"file_url":137,"file_type":138,"file_size":139,"view_count":105,"is_deleted":4,"is_public":8,"is_downloadable":8,"audit_status":8,"page_count":140,"language":141,"language_code":63,"site_id":62,"html_lang":63,"table_of_contents":142,"faqs":143,"seo_title":144,"seo_description":67,"update_tm":130,"read_time":36,"preview_page_count":4},962088006270,"https://ap-avatar.wpscdn.com/davatar_085a072bc5b1113ac321206ff7593b45","BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?  \nAsahi Ushio, Luis Espinosa-Anke, Steven Schockaert, Jose Camacho-Collados  \nCardiff NLP, School of Computer Science and Informatics Cardiff University, United Kingdom  \nfUshioA,Espinosa-AnkeL,SchockaertS1,[CamachoColladosJ](CamachoColladosJg@cardiff.ac.uk)[g](CamachoColladosJg@cardiff.ac.uk)[@cardiff.ac.uk](CamachoColladosJg@cardiff.ac.uk)  \nAbstract  \nAnalogies play a central role in human commonsense reasoning. The ability to recognize analogies such as “eye is to seeing what ear is to hearing”, sometimes referred to as analogical proportions, shape how we structure knowledge and understand language. Surprisingly, however, the task of identifying such analogies has not yet received much attention in the language model era. In this paper, we analyze the capabilities of transformer-based language models on this unsupervised task, using benchmarks obtained from educational settings, as well as more commonly used datasets. We find that off-the-shelf language models can identify analogies to a certain extent, but struggle with abstract and complex relations, and results are highly sensitive to model architecture and hyperparameters. Overall the best results were obtained with GPT-2 and RoBERTa, while configurations using BERT were not able to outperform word embedding models. Our results raise important questions for future work about how, and to what extent, pre-trained language models capture knowledge about abstract semantic relations.1  \n1 Introduction  \nOne of the most widely discussed properties of word embeddings has been their surprising ability to model certain types of relational similarities in terms of word vector differences (Mikolov  \nWhile the title is probably self-explanatory, this is a small note explaining it. BERT is to NLP what AlexNet is to CV is making an analogy on what the BERT and AlexNet models represented for Natural Language Processing (NLP) and Computer Vision (CV), respectively. They both brought a paradigm shift in how research was undertaken in their corresponding disciplines and this is what the analogy refers to.  \n1 Source code and data to reproduce our experimental results are available in the following repository: [https://github.com/asahi417/](https://github.com/asahi417/)[ ](https://github.com/asahi417/)analogy-language-model  \n\n| Query: |  | word:language |\n| --- | --- | --- |\n| Candidates: | (1)\u003Cbr>(2)\u003Cbr>(3)\u003Cbr>(4)\u003Cbr>(5) | paint:portrait\u003Cbr>poetry:rhythm\u003Cbr>note:music\u003Cbr>tale:story\u003Cbr>week:year |\n\nTable 1: An example analogy task from the SAT dataset. The third candidate is the answer to the query.  \net al., 2013a ; Vylomova et al., 2016 ; Allen and Hospedales, 2019 ; Ethayarajh et al., 2019) . The underlying assumption is that when “a is to b what c is to d” the word vector differences b 􀀀 a and d 􀀀 c are expected to be similar, where we write x for the embedding of a word x. While this assumption holds for some types of syntactic relations, for semantic relations this holds to a much more limited degree than was suggested in early work (Linzen, 2016 ; Schluter, 2018) . Moreover, the most commonly used benchmarks have focused on specific and well-defined semantic relations such as“capital of”, rather than the more abstract notion of relational similarity that is often needed for solving the kind of psychometric analogy problems that can be found in IQ tests and educational settings. An example of such a problem is shown in Table 1.  \nGiven the central role of analogy in human cognition, it is nonetheless important to understand the extent to which NLP models are able to solve these more abstract analogy problems. Besides its value as an intrinsic benchmark for lexical semantics, the ability to recognize analogies is indeed important in the contexts of human creativity (Holyoak et al., 1996), innovation (Hope et al., 2017), computational creativity (Goel, 2019) and education (Pardos and Nam, 2020) . ","cbCaig6FFAXeXBed","https://ap.wps.com/l/cbCaig6FFAXeXBed","pdf",785291,16,"English","# Abstract\n# Introduction\n## Related work and benchmarks\n## Prompting and scoring in zero-shot settings\n# Experimental results and sensitivity analysis","[{\"question\":\"What does the paper investigate about pre-trained language models?\",\"answer\":\"It analyzes how well transformer-based pre-trained language models can identify word analogies in an unsupervised, zero-shot setting.\"},{\"question\":\"What datasets and benchmarks are used for the analogy evaluation?\",\"answer\":\"The study uses benchmarks obtained from educational settings and also more commonly used public analogy datasets, including an example from the SAT dataset.\"},{\"question\":\"How do different model architectures affect analogy identification?\",\"answer\":\"The results are highly sensitive to model architecture and hyperparameters, with the best performance reported for GPT-2 and RoBERTa, while BERT configurations do not outperform word embedding models.\"}]","BERT is to NLP what AlexNet is to CV - Can Pre-Trained Language Models Identify Analogies? | PDF"]