[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-seo-657829-105":3,"detail-sidebar-cat-0-en-105":80,"doc-detail-657829-en":130},{"code":4,"msg":5,"data":6},0,"ok",{"site_id":7,"language":8,"slug":9,"title":10,"keywords":11,"description":12,"schema_data":13,"social_meta":73,"head_meta":75,"extra_data":77,"updated_unix":79},105,"en","arrows-are-the-verbs-of-diagrams","Arrows are the Verbs of Diagrams","","Arrows are a key ingredient of schematic pictorial communication. This paper investigates how arrows are interpreted using linguistic analysis, crowdsourcing, and machine-learning. The work proposes an analogy between arrows and verbs: arrows are represented via structurally and semantically distinct frames, and frame resolution yields specific interpretations using shallow world knowledge. Experiments on scientific diagrams support the semantic-frame approach and contextual resolution.",{"@graph":14,"@context":72},[15,34,55],{"@type":16,"itemListElement":17},"BreadcrumbList",[18,23,27,31],{"item":19,"name":20,"@type":21,"position":22},"https://docshare.wps.com","Home","ListItem",1,{"item":24,"name":25,"@type":21,"position":26},"https://docshare.wps.com/document/","Document",2,{"item":28,"name":29,"@type":21,"position":30},"https://docshare.wps.com/document/research-report/","Research & Report",3,{"item":32,"name":10,"@type":21,"position":33},"https://docshare.wps.com/document/arrows-are-the-verbs-of-diagrams/657829/",4,{"url":32,"name":10,"@type":35,"image":36,"author":41,"headline":10,"publisher":44,"fileFormat":47,"inLanguage":8,"description":12,"dateModified":48,"datePublished":49,"encodingFormat":47,"isAccessibleForFree":50,"interactionStatistic":51},"DigitalDocument",{"url":37,"@type":38,"width":39,"height":40},"https://docshare.wps.com/thumbnails/arrows-are-the-verbs-of-diagrams/657829.png","ImageObject",300,407,{"name":42,"@type":43},"cimolpedes","Person",{"url":19,"name":45,"@type":46},"DocShare","Organization","application/pdf","2026-10-29","2026-10-26",true,{"@type":52,"interactionType":53,"userInteractionCount":33},"InteractionCounter",{"@type":54},"ViewAction",{"@type":56,"mainEntity":57},"FAQPage",[58,64,68],{"name":59,"@type":60,"acceptedAnswer":61},"What core analogy does the paper propose for arrow interpretation?","Question",{"text":62,"@type":63},"The paper represents arrows using verb-like structural and semantic frames, then resolves frames into specific interpretations using shallow world knowledge.","Answer",{"name":65,"@type":60,"acceptedAnswer":66},"How do the authors validate their semantic frames?",{"text":67,"@type":63},"They run experiments using crowd workers’ judgments on a released corpus of scientific diagrams, showing high agreement and coverage of most items.",{"name":69,"@type":60,"acceptedAnswer":70},"How is contextual interpretation handled for certain arrow frames?",{"text":71,"@type":63},"When a frame requires a salient relationship, the authors train a machine-learning model to predict that relationship from the diagram’s textual content.","https://schema.org",{"og:url":32,"og:type":74,"og:title":10,"og:site_name":45,"og:description":12},"article",{"robots":76,"canonical":32},"index,follow",{"doc_id":78,"site_id":7},657829,1793097350,{"code":4,"msg":81,"data":82},"success",[83,87,91,95,100,105,110,114,119,122,126],{"id":22,"doc_module":4,"doc_module_name":25,"category_name":84,"show_sort_weight":85,"slug":86},"Story & Novel",90,"story-novel",{"id":26,"doc_module":4,"doc_module_name":25,"category_name":88,"show_sort_weight":89,"slug":90},"Literature",80,"literature",{"id":33,"doc_module":4,"doc_module_name":25,"category_name":92,"show_sort_weight":93,"slug":94},"Exam",70,"exam",{"id":96,"doc_module":4,"doc_module_name":25,"category_name":97,"show_sort_weight":98,"slug":99},5,"Comic",60,"comic",{"id":101,"doc_module":4,"doc_module_name":25,"category_name":102,"show_sort_weight":103,"slug":104},6,"Technology",50,"technology",{"id":106,"doc_module":4,"doc_module_name":25,"category_name":107,"show_sort_weight":108,"slug":109},7,"Healthcare",40,"healthcare",{"id":111,"doc_module":4,"doc_module_name":25,"category_name":29,"show_sort_weight":112,"slug":113},8,30,"research-report",{"id":115,"doc_module":4,"doc_module_name":25,"category_name":116,"show_sort_weight":117,"slug":118},9,"Religion & Spirituality",20,"religion-spirituality",{"id":117,"doc_module":4,"doc_module_name":25,"category_name":120,"show_sort_weight":117,"slug":121},"World Cup","world-cup",{"id":123,"doc_module":4,"doc_module_name":25,"category_name":124,"show_sort_weight":123,"slug":125},10,"Lifestyle","lifestyle",{"id":127,"doc_module":4,"doc_module_name":25,"category_name":128,"show_sort_weight":96,"slug":129},19,"General","general",{"code":4,"msg":81,"data":131},{"doc_id":78,"user_id":132,"nickname":42,"user_avatar":133,"doc_module":4,"category_id":111,"category_name":29,"doc_title":10,"doc_description":12,"doc_content":134,"file_id":135,"file_url":136,"file_type":137,"file_size":138,"view_count":33,"is_deleted":4,"is_public":22,"is_downloadable":22,"audit_status":22,"page_count":139,"language":140,"language_code":8,"site_id":7,"html_lang":8,"table_of_contents":141,"faqs":142,"seo_title":143,"seo_description":12,"update_tm":144,"read_time":112},962094243610,"https://ap-avatar.wpscdn.com/davatar_3d24733baf745e90a7e4bdd5f77d97b2","Arrows are the Verbs of Diagrams  \nMalihe Alikhani and Matthew Stone  \nComputer Science, Rutgers University  \nmalihe.alikhani, [matthew.stone@rutgers.edu](matthew.stone@rutgers.edu)  \nAbstract  \nArrows are a key ingredient of schematic pictorial communication. This paper investigates the interpretation of arrows through linguistic, crowdsourcing and machine-learning methodology. Our work establishes a novel analogy between arrows and verbs: we advocate representing arrows in terms of qualitatively different structural and semantic frames, and resolving frames to specific interpretations using shallow world knowledge.  \n1 Introduction  \nNatural communication is multimodal—people get their ideas across not just through words but through gestures, diagrams, illustrations, and even practical activity. Research in discourse has found suggestive evidence for interpretative parallels across modalities; the challenge now is to substantiate these parallelsat large scale, by developing broad-coverage cognitive models of multimodal communication.  \nThis paper illustrates the promise of new data sets to further such a general understanding of visual communication. In particular, Kembhavi et al. (2016) have curated, annotated and released a sizeable corpus of scientific diagrams in diverse domains. We draw on formal analysis, crowdsourcing, and machine-learning experiments to carry out a systematic study of the interpretation of arrows in these diagrams. The central insight in our work is to give a novel account of arrows using existing linguistic concepts and methodology—specifically, ideas developed for explaining verb meaning in context.  \nWe begin in Section 2 with a tour of work on multimodal communication, which has made a strong case for parsing diagrams to organize basic conventional elements into recursive structural relationships, and for interpreting such parses by combining compositional meaning with discourse-based inference. We use this framework in Section 3 to motivate a linguistically-inspired approach to the interpretation of arrows: we characterize arrows into four qualitatively different structures, analogous to verb subcategorization frames; we associate each structure with a meaning, analogous to verb frame semantics (Baker et al., 1998); and we describe the contextual supplementation some structures require, by analogy to the co-compositionality of generative lexicon theory (Pustejovsky, 1998, GLT) .  \nThe remainder of the paper offers empirical evidence in support of our approach. Our first experiments, presented in Section 4, assess our semantic frames for arrows in light of crowd workers'judgments about the Kembhavi et al. (2016) data set. People label our categories with high agreement, and the categories account for the overwhelming majority of items in the corpus. Moreover, we find that arrows are normally used in one sense per diagram, much as lexical items exhibit one sense per discourse (Gale et al., 1992) .  \nOur next experiments, presented in Section 5, assess our approach to contextual interpretation: certain frames must be supplemented with a salient relationship. Assuming one sense per diagram, we train a machine-learning model that predicts this relationship from the textual content of the diagram. The performance of the method corroborates our hypothesis (analogous to GLT) that these relationships can and should be resolved based on relatively shallow encyclopedic knowledge.  \nOur contributions are primarily formal—to characterize the knowledge needed to model diagrams. Fundamental challenges remain to apply such ideas in practice. We conclude in Section 6 with an  \nThis work is licensed under a Creative Commons Attribution 4 .0 International License. License details: [http://](http://)[ ](http://)[creativecommons.org/licenses/by/4.0/](creativecommons.org/licenses/by/4.0/)  \n3552  \nProceedings of the 27th International Conference on Computational Linguistics, pages 3552–3563 Santa Fe, New Mexico, USA, Augu","cbCaitN2MvYDNv2p","https://ap.wps.com/l/cbCaitN2MvYDNv2p","pdf",2002993,12,"English","# Introduction\n# Related Work\n# Experiments\n## Crowdworker Evaluation\n## Contextual Interpretation Modeling\n# Conclusion","[{\"question\":\"What core analogy does the paper propose for arrow interpretation?\",\"answer\":\"The paper represents arrows using verb-like structural and semantic frames, then resolves frames into specific interpretations using shallow world knowledge.\"},{\"question\":\"How do the authors validate their semantic frames?\",\"answer\":\"They run experiments using crowd workers’ judgments on a released corpus of scientific diagrams, showing high agreement and coverage of most items.\"},{\"question\":\"How is contextual interpretation handled for certain arrow frames?\",\"answer\":\"When a frame requires a salient relationship, the authors train a machine-learning model to predict that relationship from the diagram’s textual content.\"}]","Arrows are the Verbs of Diagrams | PDF",1792991595]