[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-82502-en":3,"doc-seo-82502-105":29,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":13,"seo_description":14,"update_tm":27,"read_time":28},82502,1099513958762,"Logic","https://ap-avatar.wpscdn.com/avatar/1000023916a998db790?x-image-process=image/resize,m_fixed,w_180,h_180&k=1782109480056885918",8,"Research & Report","Queue-Aware Graph Reinforcement Learning for UAV-ISAC-Assisted Maritime Data Collection","This paper studies high-altitude platform (HAP)-assisted sparse cooperative integrated sensing and communication (ISAC) for UAV-enabled ocean monitoring. A fleet of rotary-wing UAVs senses drifting buoys, collects monitoring data, and forwards local posterior estimates to a HAP for fusion and sparse cooperation control. The model incorporates spatially correlated sea-patch fields, patch-aware buoy dynamics, RCS-and clutter-aware echo sensing, fused posterior Cramér-Rao bounds, and propulsion-energy-limited mobility. A queue-weighted buffered-collection long-horizon Markov decision process and a structured feasible-association graph-MARL framework improve queue-weighted collection utility and transfer to larger networks.","arXiv :2607 .00324v1 [ ee ss . SY] 1 Jul 2026  \nQueue-Aware Graph Reinforcement Learning for UAV-ISAC-Assisted Maritime Data Collection  \nBohan Li, Member, IEEE, Min Ye, Haochen Liu, Yongkang Gong, Member, IEEE, Ning Gao, Member, IEEE, Jie Nie, Member, IEEE, Pei Xiao, Senior Member, IEEE, Xiuzhen Cheng, Fellow, IEEE  \nAbstract—This paper studies high-altitude platform (HAP)-assisted sparse cooperative integrated sensing and communication (ISAC) for UAV-enabled ocean monitoring. A fleet of rotary-wing UAVs senses drifting buoys, collects their monitoring data, and reports local posterior estimates to a HAP that performs fusion and sparse cooperation control. The model explicitly accounts for a spatially correlated sea-patch field, patch-aware buoy dynamics, RCS-and clutter-aware echo sensing, fused posterior Cramér-Rao bounds (PCRBs), and propulsion-energy-limited UAV mobility. The long-horizon objective is cast as a queue-weighted buffered-collection Markov decision process rather than instantaneous throughput, where each buoy maintains a backlog of buffered observations. The resulting long-horizon design is formulated as a mixed discrete-continuous problem with sensing, communication, mobility, safety, buffered-collection, and onboard-energy constraints. To address the combinatorial association component without replacing learning by a deterministic optimizer, we propose a structured feasible-association graph-MARL framework. A heterogeneous graph encoder produces candidate-edge logits, and a masked sequential b-matching policy samples legal UAV-buoy associations while exactly satisfying UAV-load and buoy-cluster constraints. A MAPPO-style training procedure, an independent queue-state value critic, and a consistency-verification protocol are then specified to support reproducible training. Simulation results on congested maritime scenarios show that the proposed policy improves the cumulative queue-weighted collection utility by about 106% over the rate-driven deterministic decoder, maintains a large margin across sea-state sweeps and medium-to-heavy traffic loads, and transfers to larger networks without fine-tuning.  \nIndex Terms—Integrated sensing and communication, maritime monitoring, UAV networks, graph neural networks, multi-agent  \nreinforcement learning.  \n~~ ~~ ✦ ~~ ~~  \n1 INTRODUCTION  \nOcean monitoring networks underpin environmental sensing, maritime safety, and the blue economy, relying on dense fleets of low-cost surface buoys and sensors to report oceanographic observations over wide, infrastructure-sparse sea areas [1] . The lack of reliable offshore backhaul and the low transmit power of such terminals make timely data delivery difficult, which motivates aerial relays that can approach the terminals on demand [2, 3] . Unmanned aerial vehicles (UAVs) are especially attractive here because their controllable mobility lets them establish strong lineof-sight uplinks to dispersed buoys and collect their buffered observations efficiently. In parallel, integrated sensing and communication (ISAC), which reuses a common waveform and aperture for both functions, has emerged as a key sixth-generation (6G) capability [4, 5] . Endowing maritime UAVs with ISAC lets a single platform localize drifting buoys and collect their data within one resource budget, a synergy well matched to the dual sensing-andcollection nature of ocean monitoring [6] .  \nB. Li, M. Ye and J. Nie are with the Faculty of Information Science and Engineering, the Engineering Research Center of Advanced Marine Physical Instruments and Equipment (Ministry of Education), and Qingdao Key Lab oratory of Optics and Optoelectronics, Ocean University of China, Qingdao 266100, China ([emails: {bohan.li](emails: {bohan.li), yemin, [niejie}@ouc.edu.cn](niejie}@ouc.edu.cn)).  \nH. Liu is with the School of Electronics and Information, Northwestern Poly technical University, Xi’an 710019, China (email: [haochenliu@nwpu.edu.cn](haochenliu@nwpu.edu.cn)).  \nY. Gong a","cbCaiarRJ2UH5pSV","https://ap.wps.com/l/cbCaiarRJ2UH5pSV","pdf",1436013,1,17,"English","en",105,"# Introduction\n## Related Works\n### UAV-Enabled ISAC","[{\"question\":\"What problem does the paper target in UAV-assisted maritime monitoring?\",\"answer\":\"It targets long-horizon UAV-ISAC design where sensing accuracy, uplink rate, propulsion energy, and UAV-buoy association are tightly coupled under drift, clutter, and limited onboard energy, making myopic throughput-based scheduling insufficient.\"},{\"question\":\"How is the long-horizon objective defined?\",\"answer\":\"The objective is formulated as a queue-weighted buffered-collection Markov decision process, where each buoy maintains a backlog of buffered observations rather than optimizing instantaneous throughput.\"},{\"question\":\"What method does the paper use to handle the association decision without relying on a deterministic optimizer?\",\"answer\":\"It proposes a structured feasible-association graph-MARL framework with a heterogeneous graph encoder that produces candidate-edge logits and a masked sequential b-matching policy to sample legal UAV-buoy associations while satisfying UAV-load and buoy-cluster constraints.\"}]",1784180973,43,{"code":4,"msg":30,"data":31},"ok",{"site_id":24,"language":23,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":27},"queue-aware-graph-reinforcement-learning-for-uav-isac-assisted-maritime-data-collection","",{"@graph":35,"@context":85},[36,53,68],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/queue-aware-graph-reinforcement-learning-for-uav-isac-assisted-maritime-data-collection/82502/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":23,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-17","2026-07-16",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What problem does the paper target in UAV-assisted maritime monitoring?","Question",{"text":75,"@type":76},"It targets long-horizon UAV-ISAC design where sensing accuracy, uplink rate, propulsion energy, and UAV-buoy association are tightly coupled under drift, clutter, and limited onboard energy, making myopic throughput-based scheduling insufficient.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How is the long-horizon objective defined?",{"text":80,"@type":76},"The objective is formulated as a queue-weighted buffered-collection Markov decision process, where each buoy maintains a backlog of buffered observations rather than optimizing instantaneous throughput.",{"name":82,"@type":73,"acceptedAnswer":83},"What method does the paper use to handle the association decision without relying on a deterministic optimizer?",{"text":84,"@type":76},"It proposes a structured feasible-association graph-MARL framework with a heterogeneous graph encoder that produces candidate-edge logits and a masked sequential b-matching policy to sample legal UAV-buoy associations while satisfying UAV-load and buoy-cluster constraints.","https://schema.org",{"og:url":51,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":51},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":45,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":45,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":45,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":45,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":45,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":45,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":45,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]