[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-85710-en":3,"doc-seo-85710-105":29,"detail-sidebar-cat-0-en-105":90},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":13,"seo_description":14,"update_tm":27,"read_time":28},85710,4398048950312,"Violet","https://ap-avatar.wpscdn.com/avatar/400002538284de19e3c?_k=1778320343897328908",8,"Research & Report","Time Imprint Learning Time-Aware Representations in Multi-Modal Knowledge Graphs","Multi-Modal Knowledge Graphs enrich entities with text and images, yet entities with highly similar multi-modal features remain difficult to distinguish. Temporal information can disambiguate such entities, but prior work seldom treats time as an explicit modality because temporal semantics are sparse and many timestamps add noise. Time Imprint models time as an entity-level modality, jointly aligning temporal, textual, and visual representations using a three-view contrastive objective. Experiments on three benchmarks show state-of-the-art link prediction, up to 6.07% overall Hits@1 improvement, and up to 58% gains for highly ambiguous samples, with only modest training overhead.","Time Imprint: Learning Time-Aware Representations in Multi-Modal Knowledge Graphs  \nPengyu Zhang  \n[p.zhang@uva.nl](p.zhang@uva.nl)[ ](p.zhang@uva.nl)University of Amsterdam Amsterdam, The Netherlands  \nKlim Zaporojets Aarhus University Aarhus, Denmark  \nCongfeng Cao  \nUniversity of Amsterdam Amsterdam, The Netherlands  \nJia-Hong Huang  \nUniversity of Amsterdam Amsterdam, The Netherlands  \nPaul Groth  \nUniversity of Amsterdam Amsterdam, The Netherlands  \narXiv :2607 .09777v 1 [ cs .CV] 8 Jul 2026  \nAbstract  \nMulti-Modal Knowledge Graphs (MMKGs) enrich entities with multiple modalities such as text and images, yet entities with highly similar multi-modal features remain difficult to distinguish. Temporal information of an entity can serve as an additional modality to disambiguate such entities, but existing approaches rarely treat time as a separate modality alongside text and images due to two major challenges: (1) sparse temporal semantics, which hinder alignment with richer modalities, and (2) multiple timestamps, which introduce noise or reduce robustness in representation learning. To address these challenges, we propose Time Imprint, a framework that treats time as an entity-level modality and jointly aligns temporal, textual, and visual representations via a three-view contrastive objective. Additionally, to mitigate multi-timestamp ambiguity, Time Imprint studies a compact timestamp subset selection design space and aggregates the selected timestamps into a discriminative temporal embedding with attention pooling, balancing temporal specificity and robustness. Experiments on three MMKG benchmarks demonstrate that Time Imprint achieves state-ofthe-art link prediction performance, improving Hits@1 by up to 6.07% overall and yielding up to 58% gains on the subset of the top-1% ambiguity samples. We further examine different fusion strategies and the sensitivity to timestamp availability and quality, clarifying when and why time-as-modality is most beneficial, while adding only modest training overhead. We release our code at [https://anonymous.4open.science/r/Time-Imprint](https://anonymous.4open.science/r/Time-Imprint).  \nCCS Concepts  \n• Computing methodologies → Knowledge representation and reasoning; • Information systems → Multimedia and multimodal retrieval; Temporal data.  \nPermission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission [and/or a fee. Request permissions from permissions@acm.org](and/or a fee. Request permissions from permissions@acm.org).  \nConference acronym ’XX, Woodstock, NY  \n© 2018 Copyright held by the owner/author(s) . Publication rights licensed to ACM. ACM ISBN 978-1-4503-XXXX-X/2018/06  \n[https://doi.org/XXXXXXX.XXXXXXX](https://doi.org/XXXXXXX.XXXXXXX)  \nKeywords  \nMulti-modal Knowledge Graphs, Temporal Representation Learning, Contrastive Learning, Modality Fusion, Link Prediction  \nACM Reference Format:  \nPengyu Zhang, Klim Zaporojets, Congfeng Cao, Jia-Hong Huang, and Paul Groth. 2018. Time Imprint: Learning Time-Aware Representations in MultiModal Knowledge Graphs. In Proceedings of Make sure to enter the correct conference title from your rights confirmation email (Conference acronym ’XX) . ACM, New York, NY, USA, 11 pages. [https://doi.org/XXXXXXX.XXXXXXX](https://doi.org/XXXXXXX.XXXXXXX)  \n1 Introduction  \nMulti-Modal Knowledge Graphs (MMKGs) enrich entity representations by integrating text, images, audio, and video with structured triples and are widely used in Web applications such as recommendation and search [17] . For ex","cbCaitBYgBtXl0a8","https://ap.wps.com/l/cbCaitBYgBtXl0a8","pdf",1396815,1,11,"English","en",105,"# Introduction\n## Motivation and problem of multimodal ambiguity\n## Limitations of prior time modeling\n# Method (Time Imprint)\n## Time as an entity-level modality\n## Three-view contrastive alignment\n## Timestamp subset selection and attention pooling\n# Experiments\n## Benchmark results and improvements\n## Analysis of fusion strategies and timestamp quality\n# Conclusion\n## When time-as-modality is most beneficial","[{\"question\":\"Why are multi-modal entities difficult to distinguish in multi-modal knowledge graphs?\",\"answer\":\"Entities can share highly similar text and visual content, causing ambiguity that harms representation learning and link prediction.\"},{\"question\":\"What major challenges prevent using time as a separate modality alongside text and images?\",\"answer\":\"Temporal semantics are sparse, making alignment with richer modalities difficult; additionally, multiple timestamps introduce noise and reduce robustness.\"},{\"question\":\"How does Time Imprint improve link prediction using time information?\",\"answer\":\"It treats time as an entity-level modality and jointly aligns temporal, textual, and visual embeddings with a three-view contrastive objective, while selecting compact timestamp subsets and aggregating them into a discriminative temporal embedding via attention pooling.\"}]",1784205735,28,{"code":4,"msg":30,"data":31},"ok",{"site_id":24,"language":23,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":85,"head_meta":87,"extra_data":89,"updated_unix":27},"time-imprint-learning-time-aware-representations-in-multi-modal-knowledge-graphs","",{"@graph":35,"@context":84},[36,53,67],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/time-imprint-learning-time-aware-representations-in-multi-modal-knowledge-graphs/85710/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":61,"encodingFormat":60,"isAccessibleForFree":62,"interactionStatistic":63},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-16",true,{"@type":64,"interactionType":65,"userInteractionCount":4},"InteractionCounter",{"@type":66},"ViewAction",{"@type":68,"mainEntity":69},"FAQPage",[70,76,80],{"name":71,"@type":72,"acceptedAnswer":73},"Why are multi-modal entities difficult to distinguish in multi-modal knowledge graphs?","Question",{"text":74,"@type":75},"Entities can share highly similar text and visual content, causing ambiguity that harms representation learning and link prediction.","Answer",{"name":77,"@type":72,"acceptedAnswer":78},"What major challenges prevent using time as a separate modality alongside text and images?",{"text":79,"@type":75},"Temporal semantics are sparse, making alignment with richer modalities difficult; additionally, multiple timestamps introduce noise and reduce robustness.",{"name":81,"@type":72,"acceptedAnswer":82},"How does Time Imprint improve link prediction using time information?",{"text":83,"@type":75},"It treats time as an entity-level modality and jointly aligns temporal, textual, and visual embeddings with a three-view contrastive objective, while selecting compact timestamp subsets and aggregating them into a discriminative temporal embedding via attention pooling.","https://schema.org",{"og:url":51,"og:type":86,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":88,"canonical":51},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":91},[92,96,100,104,109,114,119,122,127,130,134],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":93,"show_sort_weight":94,"slug":95},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":97,"show_sort_weight":98,"slug":99},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":101,"show_sort_weight":102,"slug":103},"Exam",70,"exam",{"id":105,"doc_module":4,"doc_module_name":45,"category_name":106,"show_sort_weight":107,"slug":108},5,"Comic",60,"comic",{"id":110,"doc_module":4,"doc_module_name":45,"category_name":111,"show_sort_weight":112,"slug":113},6,"Technology",50,"technology",{"id":115,"doc_module":4,"doc_module_name":45,"category_name":116,"show_sort_weight":117,"slug":118},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":45,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":45,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":45,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":45,"category_name":136,"show_sort_weight":105,"slug":137},19,"General","general"]