[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-85622-en":3,"doc-seo-85622-105":29,"detail-sidebar-cat-0-en-105":83},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":13,"seo_description":14,"update_tm":27,"read_time":28},85622,4810365810221,"Aurora","https://ap-avatar.wpscdn.com/davatar_155a257f0dc6eb9ab79c44ca47cae57d",8,"Research & Report","Scaling Tactile Commonsense Reasoning to the Open World with Large-scale Data and Action-aware Representation","Touch is a key modality for embodied agents, yet scaling tactile commonsense reasoning to realistic open-world settings is limited by two bottlenecks: tactile datasets are too small and lack diverse formats, and tactile signals are redundant and action-specific while existing models often treat all frames uniformly. TouchThinker addresses both data and representation issues by building TouchThinker-1M, a million-scale multi-source visuotactile dataset, and TouchThinker-Bench for open-world evaluation, plus action-aware modeling to improve representation efficiency and reasoning quality.",": Scaling Tactile Commonsense Reasoning to the Open World with Large-scale Data and Action-aware Representation  \narXiv :2606 . 1 1637v 3 [ cs .AI] 12 Jul 2026  \nKailin Lyu1,3 , Di Wu1 , Pengwei Zhang1 , Yuhang Zheng2 , Yingxin Lai4 , Long Xiao1 , Kangyi Wu5 , Pengna Li5 , Chen Gao2 , Lianyu Hu6 ,  \nXiaobin Hu2,B , Jie Hao1,B , Ce Hao3,B , Weihao Yuan7 , Shuicheng Yan2,B  \n1Institute of Automation, Chinese Academy of Sciences  \n2National University of Singapore, 3Zhongguancun Academy, 4Xiamen University  \n5Xi’an Jiaotong University, 6Nanyang Technological University, 7Nanjing University BCorresponding authors  \nFigure 1: The core contributions of TouchThinker. (1) We propose an action-aware tactile encoder to enable efficient tactile representation learning. Upon it, we construct TouchThinker-1M, a million-scale, multi-source Visuotactile dataset that expands the scope of tactile reasoning. (2) We further introduce TouchThinker-Bench to support multi-dimensional evaluation of open-world tactile reasoning. (3) Across multiple tasks, TouchThinker achieves significant improvements over prior methods.  \nAbstract  \nTouch is a key modality for embodied agents to understand the physical world. Although recent work has incorporated tactile signals into language systems for tactile commonsense reasoning, scaling such systems to realistic openworld settings remains challenging due to two key bottlenecks: (1) current tactile reasoning datasets remain limited in format and scale, providing insufficient supervision for reasoning from tactile observations to physical commonsense and hindering the learning of transferable tactile commonsense; (2) Tactile signals are inherently redundant and action-specific, yet existing methods often overlook these properties, resulting in inefficient representations with limited semantic expressiveness. To address these limitations, we propose TouchThinker, a tactile-language framework that scales tactile commonsense reasoning to the open world from both data and representation perspectives. First, we construct TouchThinker-1M,  \na million-scale, multi-source tactile reasoning dataset covering 415 objects, 8 scenarios, and  \n7 sensor types, providing a solid data foundation for open-world generalization. We further introduce TouchThinker-Bench, an openworld benchmark with more realistic and diverse tasks. Then, we propose action-aware modeling mechanism to improve tactile representation efficiency and enable efficient reasoning. Experimental results demonstrate that TouchThinker achieves competitive performance against state-of-the-art models across multiple datasets. Our code and dataset will be made available at: [https://github.com/](https://github.com/)[ ](https://github.com/)lvkailin0118/TouchThinker.  \n1 Introduction  \nAmong human senses, touch is fundamental for perceiving and interacting with the physical world. It provides physical cues that vision alone cannot reliably capture, including material properties, surface  \ntexture, and contact state, thereby supporting physical reasoning and action decisions (Li et al., 2024b) . For example, when a person touches a hard grain of rice, they can infer that it is under-ripe; similarly, when touching a soft sponge, they can deduce that it is suitable for wiping based on the context. Therefore, incorporating tactile information into commonsense reasoning frameworks and developing tactile reasoning in open-world scenarios are crucial for advancing embodied intelligence.  \nSeveral recent studies have begun to integrate tactile perception with large language models (Yu et al., 2024, 2025 ; Xie et al., 2026 ; Cheng et al., 2026), enabling robots to perform tactile understanding tasks under natural language instructions. Despite these advances, existing approaches still struggle to achieve reliable and robust tactile reasoning in open-world environments, primarily due to limitations in data and representation. (1) On the data side, existing public tactile reason","cbCairVDnBEFZ6Gu","https://ap.wps.com/l/cbCairVDnBEFZ6Gu","pdf",2595109,1,18,"English","en",105,"# Abstract\n# Introduction\n## Motivation and key bottlenecks\n## Data-side contributions\n## Representation-side contributions\n## Proposed TouchThinker framework","[{\"question\":\"How does TouchThinker improve tactile representation beyond prior approaches?\",\"answer\":\"It introduces action-aware modeling to learn more efficient tactile representations, reducing noise from low-information frames and aligning action types with question semantics.\"}]",1784205006,45,{"code":4,"msg":30,"data":31},"ok",{"site_id":24,"language":23,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":78,"head_meta":80,"extra_data":82,"updated_unix":27},"scaling-tactile-commonsense-reasoning-to-the-open-world-with-large-scale-data-and-action-aware-representation","",{"@graph":35,"@context":77},[36,53,68],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/scaling-tactile-commonsense-reasoning-to-the-open-world-with-large-scale-data-and-action-aware-representation/85622/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-17","2026-07-16",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71],{"name":72,"@type":73,"acceptedAnswer":74},"How does TouchThinker improve tactile representation beyond prior approaches?","Question",{"text":75,"@type":76},"It introduces action-aware modeling to learn more efficient tactile representations, reducing noise from low-information frames and aligning action types with question semantics.","Answer","https://schema.org",{"og:url":51,"og:type":79,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":81,"canonical":51},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":84},[85,89,93,97,102,107,112,115,120,123,127],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":86,"show_sort_weight":87,"slug":88},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":90,"show_sort_weight":91,"slug":92},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":94,"show_sort_weight":95,"slug":96},"Exam",70,"exam",{"id":98,"doc_module":4,"doc_module_name":45,"category_name":99,"show_sort_weight":100,"slug":101},5,"Comic",60,"comic",{"id":103,"doc_module":4,"doc_module_name":45,"category_name":104,"show_sort_weight":105,"slug":106},6,"Technology",50,"technology",{"id":108,"doc_module":4,"doc_module_name":45,"category_name":109,"show_sort_weight":110,"slug":111},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":113,"slug":114},30,"research-report",{"id":116,"doc_module":4,"doc_module_name":45,"category_name":117,"show_sort_weight":118,"slug":119},9,"Religion & Spirituality",20,"religion-spirituality",{"id":118,"doc_module":4,"doc_module_name":45,"category_name":121,"show_sort_weight":118,"slug":122},"World Cup","world-cup",{"id":124,"doc_module":4,"doc_module_name":45,"category_name":125,"show_sort_weight":124,"slug":126},10,"Lifestyle","lifestyle",{"id":128,"doc_module":4,"doc_module_name":45,"category_name":129,"show_sort_weight":98,"slug":130},19,"General","general"]