[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-86548-en":3,"doc-seo-86548-105":30,"detail-sidebar-cat-0-en-105":92},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":21,"is_downloadable":21,"audit_status":21,"page_count":22,"language":23,"language_code":24,"site_id":25,"html_lang":24,"table_of_contents":26,"faqs":27,"seo_title":13,"seo_description":14,"update_tm":28,"read_time":29},86548,13056703019662,"Evangeline","https://ap-avatar.wpscdn.com/avatar/be000253a8e92610077?_k=1778726343310543188",8,"Research & Report","GPU Tile Sim A Tile-Centric GPU Simulation Framework for LLM Hardware-Software Co-Design","Modern LLM workloads increasingly depend on optimized GPU kernels created through hardware-software co-design. Achieving performance requires fine-grained dependency scheduling and overlap between computation and memory movement, which makes existing GPU performance models harder to use. Instruction-driven simulators are expensive to adapt, while analytical models are too coarse. GPU-Tile-Sim (GTSim) models kernel execution using a warp-level tile graph, capturing tile operations and explicit dataflow and ordering constraints. Evaluations on GEMM, attention, and end-to-end inference show high modeling accuracy across A100 and H100, and early validation on Blackwell.","GPU-Tile-Sim: A Tile-Centric GPU Simulation Framework for LLM Hardware-Software Co-Design  \nYitong Ding  \nShanghai Jiao Tong University China [dingyitong@sjtu.edu.cn](dingyitong@sjtu.edu.cn)  \nYangjie Zhou∗ National University of Singapore Singapore [yj_zhou@nus.edu.sg](yj_zhou@nus.edu.sg)  \nJiawei Huang  \nShanghai Jiao Tong University China [huangjiawei@sjtu.edu.cn](huangjiawei@sjtu.edu.cn)  \nZihan Liu∗ Shanghai Jiao Tong University China [altair.liu@sjtu.edu.cn](altair.liu@sjtu.edu.cn)  \nRenyang Guan Shanghai Jiao Tong University  \nChina [guanrenyang@alumni.sjtu.edu.cn](guanrenyang@alumni.sjtu.edu.cn)  \nYu Feng  \nShanghai Jiao Tong University China [y-feng@sjtu.edu.cn](y-feng@sjtu.edu.cn)  \narXiv :2607 . 11262v1 [ cs .DC] 13 Jul 2026  \nShixuan Sun  \nShanghai Jiao Tong University China [sunshixuan@sjtu.edu.cn](sunshixuan@sjtu.edu.cn)  \nMingyi Guo  \nShanghai Jiao Tong University China [guo-my@cs.sjtu.edu.cn](guo-my@cs.sjtu.edu.cn)  \nJingwen Leng  \nShanghai Jiao Tong University China [leng-jw@cs.sjtu.edu.cn](leng-jw@cs.sjtu.edu.cn)  \nJian Weng  \nKing Abdullah University of Science and Technology (KAUST) Saudi Arabia [jian.weng@kaust.edu.sa](jian.weng@kaust.edu.sa)  \nAbstract  \nModern LLM (large language model) workloads increasingly rely on optimized GPU kernels through hardware-software co-design. These kernels achieve high-performance through fine-grained dependency scheduling and computation-memory overlap. As such, they incur new challenges on existing GPU performance models. Instruction-driven simulators are costly to adapt to evolving architectures, while analytical models are too coarse to capture kernels’characteristics. We propose GPU-Tile-Sim (GTSim), a tile-centric GPU simulation framework for LLM hardware-software co-design. The key insight is that modern LLM kernel performance is governed less by individual instruction latency than by the dependency structure that controls execution order and overlap. Accordingly, GTSim represents kernel execution as a warp-level tile graph whose nodes capture tile-level operations and whose edges encode data and ordering constraints. Using this representation, we design an automatic tile-graph frontend and a graph-driven simulation backend. We evaluate GTSim on representative GEMM, attention, and end-to-end LLM inference workloads. On A100 and H100 across both conventional and highly optimized kernels, GTSim achieves high performance-modeling accuracy (MAPE, Mean Absolute Percentage Error, 1.22%–8.71%). We further extend GTSim to Blackwell with preliminary validation, and demonstrate its effectiveness in analyzing software and architectural design choices.  \nKeywords  \nGPU simulation, LLM workloads, tile graph, hardware-software co-design, performance modeling  \n∗ Corresponding authors.  \n1 Introduction  \nModern GPUs are key platforms for LLM workload execution. To better exploit their peak performance, recent GPUs introduce features enabled by hardware-software co-design, such as Tensor Memory Accelerator, distributed share memory, and Tensor Memory [28– 30]. As Tensor Core throughput continues to increase and execution becomes coarser-grained, sustaining high utilization requires kernels to keep compute pipelines fed through tiling, kernel fusion, and multi-stage software pipelines that overlap data movement with matrix computation. At the same time, increasingly asynchronous data-movement and on-chip sharing mechanisms encourage programming styles based on producer–consumer coordination, warp specialization, and explicit data placement [7, 10, 22, 25, 36, 47]. As a result, performance increasingly depends on co-designing software execution with these evolving hardware mechanisms.  \nTo guide such hardware-software co-design, GPU performance models must predict how software and architectural choices interact to affect performance. Existing approaches fall into two broad categories: instruction-driven simulators and analytical models, with the latter further divided into interval-","cbCaiijv5ZN7kZvW","https://ap.wps.com/l/cbCaiijv5ZN7kZvW","pdf",1511186,5,1,14,"English","en",105,"# Abstract\n# Keywords\n# Introduction","[{\"question\":\"What problem does GPU-Tile-Sim (GTSim) address in LLM GPU hardware-software co-design?\",\"answer\":\"GTSim targets the difficulty of accurately modeling how modern GPU kernels achieve performance through dependency scheduling and computation-memory overlap, which existing instruction-driven simulators and coarse analytical models struggle to capture efficiently.\"},{\"question\":\"How does GTSim represent GPU kernel execution?\",\"answer\":\"GTSim represents execution as a dependency-driven warp-centric tile graph, where nodes correspond to tile-level operations executed by warps or cooperating warp groups and edges encode dataflow and ordering constraints.\"},{\"question\":\"What evidence of effectiveness does the document provide?\",\"answer\":\"Experiments on GEMM, attention, and end-to-end LLM inference workloads show high performance-modeling accuracy on A100 and H100 across conventional and highly optimized kernels, measured by MAPE of 1.22%–8.71%, with additional preliminary validation on Blackwell.\"}]",1784212562,35,{"code":4,"msg":31,"data":32},"ok",{"site_id":25,"language":24,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":87,"head_meta":89,"extra_data":91,"updated_unix":28},"gpu-tile-sim-a-tile-centric-gpu-simulation-framework-for-llm-hardware-software-co-design","",{"@graph":36,"@context":86},[37,54,69],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":21},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/gpu-tile-sim-a-tile-centric-gpu-simulation-framework-for-llm-hardware-software-co-design/86548/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":24,"description":14,"dateModified":62,"datePublished":63,"encodingFormat":61,"isAccessibleForFree":64,"interactionStatistic":65},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-07-25","2026-07-16",true,{"@type":66,"interactionType":67,"userInteractionCount":20},"InteractionCounter",{"@type":68},"ViewAction",{"@type":70,"mainEntity":71},"FAQPage",[72,78,82],{"name":73,"@type":74,"acceptedAnswer":75},"What problem does GPU-Tile-Sim (GTSim) address in LLM GPU hardware-software co-design?","Question",{"text":76,"@type":77},"GTSim targets the difficulty of accurately modeling how modern GPU kernels achieve performance through dependency scheduling and computation-memory overlap, which existing instruction-driven simulators and coarse analytical models struggle to capture efficiently.","Answer",{"name":79,"@type":74,"acceptedAnswer":80},"How does GTSim represent GPU kernel execution?",{"text":81,"@type":77},"GTSim represents execution as a dependency-driven warp-centric tile graph, where nodes correspond to tile-level operations executed by warps or cooperating warp groups and edges encode dataflow and ordering constraints.",{"name":83,"@type":74,"acceptedAnswer":84},"What evidence of effectiveness does the document provide?",{"text":85,"@type":77},"Experiments on GEMM, attention, and end-to-end LLM inference workloads show high performance-modeling accuracy on A100 and H100 across conventional and highly optimized kernels, measured by MAPE of 1.22%–8.71%, with additional preliminary validation on Blackwell.","https://schema.org",{"og:url":52,"og:type":88,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":90,"canonical":52},"index,follow",{"doc_id":7,"site_id":25},{"code":4,"msg":5,"data":93},[94,98,102,106,110,115,120,123,128,131,135],{"id":21,"doc_module":4,"doc_module_name":46,"category_name":95,"show_sort_weight":96,"slug":97},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":99,"show_sort_weight":100,"slug":101},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":103,"show_sort_weight":104,"slug":105},"Exam",70,"exam",{"id":20,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":20,"slug":138},19,"General","general"]