[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-84095-en":3,"doc-seo-84095-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":21,"is_downloadable":21,"audit_status":21,"page_count":22,"language":23,"language_code":24,"site_id":25,"html_lang":24,"table_of_contents":26,"faqs":27,"seo_title":13,"seo_description":14,"update_tm":28,"read_time":29},84095,1099514067438,"River Wang","https://ap-avatar.wpscdn.com/avatar/100002539ee87300030?x-image-process=image/resize,m_fixed,w_180,h_180&k=1780474512215547542",8,"Research & Report","Synthetic-to-Real Translation for Class-Agnostic Motion Prediction","Motion understanding is essential for safety and robustness in autonomous driving, yet real-world motion labels are costly to obtain. This work studies synthetic-to-real translation for motion prediction (SRMP) and addresses the instability of naive motion regression under synthetic-to-real domain shift. The proposed SRMP integrates objectness-aware motion prediction to learn domain-invariant features and objectness-aided motion enhancement to refine pseudo motion labels by filtering motion noise. A physically based pipeline generates Motion4D, the first synthetic 4D LiDAR dataset for SRMP, enabling improved performance on real scenes.","Synthetic-to-Real Translation for Class-Agnostic Motion Prediction  \nYizheng Wu* , Hongwei Fan* , Kewei Wang, Ruibo Li, Xingyi Li, Xiao Song, Zhe Wang, Chenjing Ding,  \nDongliang Wang, Zhiguo Cao, Guosheng Lin  \narXiv :2607 .063 19v 1 [ cs .CV] 7 Jul 2026  \nAbstract—Motion understanding is critical for ensuring safety and robustness in autonomous driving systems, driving increasing interest in motion prediction. A key challenge in this domain is the high cost associated with acquiring real-world motion labels. It is therefore ideal if we could transfer motion knowledge from synthetic data to real data. In this context, we explore the potential of synthetic-to-real translation for motion prediction (SRMP). However, the most used naive motion regression methods are notably sensitive to the synthetic-to-real domain shift, resulting in unreliable knowledge translation. To address this, we propose a novel approach integrating a motion knowledge translation framework with two key components: (1) objectness-aware motion prediction, which explicitly models the joint distribution of motion patterns and objectness priors to improve domaininvariant feature learning, and (2) objectness-aided motion enhancement, a motion label refinement mechanism that leverages learned objectness priors to filter motion noise. Furthermore, we present a physically-based pipeline for generating Motion4D, the first synthetic 4D LiDAR dataset tailored for SRMP research, addressing the lack of synthetic motion datasets. Experimental results demonstrate that our approach effectively bridges the domain gaps and yields superior performance on real scenes. Code and dataset will be made publicly available.  \nI. INTRODUCTION  \nMotion prediction [1]–[5] aims to predict future motion displacements based on past observations from multimodal sensors, playing a crucial role in path planning and navigation for autonomous driving systems. To mitigate failures when dealing with unknown classes, many recent motion prediction approaches [4], [6], [7] adopt a class-agnostic paradigm to directly regress cell-wise motions. These approaches transform the point clouds into bird’s eye view (BEV) maps and represent motions as 2D displacements along the ground plane, achieving convincing performance. However, it is extremely challenging and costly to obtain motion labels on real data due to the sparse and non-uniform nature of point clouds [8], [9] .  \nYizheng Wu, Kewei Wang, and Xingyi Li are with the Key Laboratory of Image Processing and Intelligent Control, Ministry of Education, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China, and also with Nanyang Technological University, Singapore 639798, Singapore.  \nHongwei Fan, Xiao Song, Zhe Wang, Chenjing Ding, and Dongliang Wang are with the SenseAuto, Beijing 100080, China.  \nZhiguo Cao is with the Key Laboratory of Image Processing and Intelligent Control, Ministry of Education, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China.  \nRuibo Li, Guosheng Lin is with Nanyang Technological University, Singapore 639798, Singapore.  \nCorresponding author: Guosheng Lin. Email: [gslin@ntu.edu.sg](gslin@ntu.edu.sg)[ ](gslin@ntu.edu.sg)Yizheng Wu and Hongwei Fan contributed equally.  \nThis paper has supplementary downloadable material available at [http://ieeexplore.ieee.org](http://ieeexplore.ieee.org)., provided by the author. The material includes a video comparing our dataset with other real-world datasets. This material is 142MB in size.  \nReal-World  \nReal-World  \nTarget Data   \nT  S  \nEMA  \nNoisy Pseudo Labels  \nInitial Pseudo Labels  \nImproved Pseudo Labels  \n(a) Baseline. (b) Ours (SR-Motion) .  \nGround Truth Initial Pseudo Labels Improved Pseudo Labels  \n(c) Visualization of motions.  \nFig. 1. Problem identification and resolution for SRMP. (a) The naive regression of motions results in noisy pseudo labe","cbCaigaOB3I8SqMY","https://ap.wps.com/l/cbCaigaOB3I8SqMY","pdf",10450192,2,1,16,"English","en",105,"# Introduction\n# Synthetic-to-Real Motion Prediction (SRMP)\n## Objectness-aware motion prediction\n## Objectness-aided motion enhancement\n# Motion4D dataset generation\n## Physically-based pipeline\n# Experimental results and expected release","[{\"question\":\"为什么合成数据到真实数据的知识迁移在运动预测中很难？\",\"answer\":\"因为合成与真实数据在运动分布、遮挡模式和目标组成上存在显著域差。仅用合成数据训练会在真实场景中出现明显性能退化。\"},{\"question\":\"作者提出的 SRMP 方案包含哪些关键组成？\",\"answer\":\"方案整合两部分：objectness-aware motion prediction，用于显式建模运动模式与目标性先验以学习域不变特征；objectness-aided motion enhancement，用于利用学习到的目标性先验细化并过滤噪声伪标签。\"},{\"question\":\"Motion4D 数据集在这项研究中扮演什么角色？\",\"answer\":\"Motion4D 通过物理驱动流程生成首个面向 SRMP 研究的合成 4D LiDAR 数据集，直接提供准确的合成运动标签，从而支持合成到真实的知识学习与迁移。\"}]",1784192749,40,{"code":4,"msg":31,"data":32},"ok",{"site_id":25,"language":24,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"synthetic-to-real-translation-for-class-agnostic-motion-prediction","",{"@graph":36,"@context":85},[37,53,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,47,50],{"item":41,"name":42,"@type":43,"position":21},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":20},"https://docshare.wps.com/document/","Document",{"item":48,"name":12,"@type":43,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":43,"position":52},"https://docshare.wps.com/document/synthetic-to-real-translation-for-class-agnostic-motion-prediction/84095/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":24,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":41,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-07-25","2026-07-16",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"为什么合成数据到真实数据的知识迁移在运动预测中很难？","Question",{"text":75,"@type":76},"因为合成与真实数据在运动分布、遮挡模式和目标组成上存在显著域差。仅用合成数据训练会在真实场景中出现明显性能退化。","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"作者提出的 SRMP 方案包含哪些关键组成？",{"text":80,"@type":76},"方案整合两部分：objectness-aware motion prediction，用于显式建模运动模式与目标性先验以学习域不变特征；objectness-aided motion enhancement，用于利用学习到的目标性先验细化并过滤噪声伪标签。",{"name":82,"@type":73,"acceptedAnswer":83},"Motion4D 数据集在这项研究中扮演什么角色？",{"text":84,"@type":76},"Motion4D 通过物理驱动流程生成首个面向 SRMP 研究的合成 4D LiDAR 数据集，直接提供准确的合成运动标签，从而支持合成到真实的知识学习与迁移。","https://schema.org",{"og:url":51,"og:type":87,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":89,"canonical":51},"index,follow",{"doc_id":7,"site_id":25},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,119,122,127,130,134],{"id":21,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":20,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":29,"slug":118},7,"Healthcare","healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":120,"slug":121},30,"research-report",{"id":123,"doc_module":4,"doc_module_name":46,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":46,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":46,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":46,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]