[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-123680-en":3,"doc-seo-123680-105":29,"detail-sidebar-cat-0-en-105":90},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":11,"language":21,"language_code":22,"site_id":23,"html_lang":22,"table_of_contents":24,"faqs":25,"seo_title":26,"seo_description":14,"update_tm":27,"read_time":28},123680,34359740700684,"Finn","https://ap-avatar.wpscdn.com/avatar/1f400023980c374ae676?_k=1777273430885731487",6,"Technology","ImmersiveIML - Immersive interactive machine learning for 3D point cloud classification - the neural network at your fingertips","ImmersiveIML proposes an immersive, interactive virtual reality (VR) dialogue for interactive machine learning (IML) aimed at classifying points in 3D point clouds. The system supports an iterative human-in-the-loop trial-and-error process that converges to classifications aligned with human intent. Interactions are designed to be expressive yet minimal, combining 6-DOF controllers for direct interaction via minimal brushing, a fast trainable machine learning model, and immediate visual feedback of classification results. Results are validated through scenarios including 3D edge detection and city LiDAR tree classification.","ImmersiveIML – Immersive interactive machine learning for 3D point cloud classification: the neural network at  \nyour fingertips  \nMaxime Cordeil, Thomas Billy, Nicolas Mellado, Loïc Barthe, Nadine  \nCouture, Patrick Reuter  \n To cite this version:  \nMaxime Cordeil, Thomas Billy, Nicolas Mellado, Loïc Barthe, Nadine Couture, et al.. ImmersiveIML – Immersive interactive machine learning for 3D point cloud classification: the neural network at your fingertips. IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMARAdjunct 2023), Oct 2023, Sydney, Australia. pp.81-85, 10 . 1109/ISMAR-Adjunct60411 .2023.00025 . hal-04246601  \nHAL Id: hal-04246601 [https://hal.science/hal-04246601](https://hal.science/hal-04246601)  \nSubmitted on 17 Oct 2023  \nHAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.  \nL’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non,émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.  \nImmersiveIML – Immersive interactive machine learning for 3D point cloud classification: the neural network at your fingertips  \nMaxime Cordeil* University of Queensland  \nLo¨ıc Barthe‡ CNRS, IRIT, Universit de Toulouse  \nThomas Billy University of Queensland  \nNicolas Mellado† CNRS, IRIT, Universit de Toulouse  \nNadine Couture§ Univ. Bordeaux, ESTIA Institute of Technology  \nPatrick Reuter¶  \nUniv. Bordeaux, Inria, LaBRI, ESTIA  \nHuman  \nclassification  \nintent (1) Direct input:  \nlabelling of two subsets  \nP1 and P2  \n(2) Training and inference:  \nclassification of all points in P  \n(3) Output:  \nvisualisation of the result  \nFigure 1: Starting from a human intent, the iterative human-in-the-loop process is composed of (1) 6-DOF controllers to allow direct interaction in large 3D point clouds via a minimal brushing technique,(2) a fast trainable machine learning model, and (3) the direct visual feedback of classification results. In the shown iteration, the classification result does not correspond to the user’s intent, so they refine the input to eventually converge to an acceptable classification of the data, iteratively.  \nABSTRACT  \nWe propose an initial exploration of an interactive machine-learning (IML) dialogue in immersive, interactive Virtual Reality (VR) for the classification of points in 3D point clouds. We contribute ImmersiveIML, an Immersive Analytics tool which builds on humanmachine learning trial-and-error dialogue to support an iterative classification process of points in the 3D point cloud. The interactions in ImmersiveIML are designed to be both expressive and minimal; we designed the iterative process to be supported by (1) 6-DOF controllers to allow direct interaction in large 3D point clouds via a minimal brushing technique,(2) a fast trainable machine learning model, and (3) the direct visual feedback of classification results.  \n*[e-mail: m.cordeil@uq.edu.au](e-mail: m.cordeil@uq.edu.au)[ ](e-mail: m.cordeil@uq.edu.au)†e-mail: [nicolas.mellado@irit.fr](nicolas.mellado@irit.fr)[ ](nicolas.mellado@irit.fr)‡e-mail: [loic.barthe@irit.fr](loic.barthe@irit.fr)  \n§ e-mail: [n.couture@estia.fr](n.couture@estia.fr)[ ](n.couture@estia.fr)¶ e-mail: [preuter@labri.fr](preuter@labri.fr)  \nThis constitutes an iterative human-in-the-loop process that eventually converges to a classification according to human intent. We argue that this approach is a novel contribution that supports a constant improvement of the classification model and fast tracks classification tasks with this type of data, in an immersive scenario. We report on the design and implementation of ImmersiveIML and demonstrate its capabilities with two emblemat","cbCaieORtyYaZ8mM","https://ap.wps.com/l/cbCaieORtyYaZ8mM","pdf",3776269,1,"English","en",105,"# Abstract\n# 1 Introduction\n## 3D point clouds and classification challenges\n## Human-in-the-loop and interactive machine learning motivation\n# Human classification intent and iterative workflow","[{\"question\":\"What problem does ImmersiveIML address in 3D point cloud classification?\",\"answer\":\"It targets the challenge of obtaining classifications that match specific user needs, which is difficult when humans are not involved during learning. ImmersiveIML integrates human input to refine and verify classification outputs.\"},{\"question\":\"How does the system enable interaction in large 3D point clouds?\",\"answer\":\"It uses 6-DOF controllers to support direct interaction in large point clouds via a minimal brushing technique. Users provide input subsets (P1 and P2) and the model learns from them for training and inference.\"},{\"question\":\"What interaction loop leads to convergence toward the intended classification?\",\"answer\":\"The process iteratively compares the classification result with the user’s intent and lets the user refine the input. Through repeated interaction cycles, the workflow converges to an acceptable classification.\"}]","ImmersiveIML - Immersive interactive machine learning for 3D point cloud classification - the neural network at your fingertips | PDF",1785817970,15,{"code":4,"msg":30,"data":31},"ok",{"site_id":23,"language":22,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":85,"head_meta":87,"extra_data":89,"updated_unix":27},"immersiveiml-immersive-interactive-machine-learning-for-3d-point-cloud-classification-the-neural-network-at-your-fingertips","",{"@graph":35,"@context":84},[36,53,67],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/technology/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/immersiveiml-immersive-interactive-machine-learning-for-3d-point-cloud-classification-the-neural-network-at-your-fingertips/123680/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":22,"description":14,"dateModified":61,"datePublished":61,"encodingFormat":60,"isAccessibleForFree":62,"interactionStatistic":63},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-08-04",true,{"@type":64,"interactionType":65,"userInteractionCount":20},"InteractionCounter",{"@type":66},"ViewAction",{"@type":68,"mainEntity":69},"FAQPage",[70,76,80],{"name":71,"@type":72,"acceptedAnswer":73},"What problem does ImmersiveIML address in 3D point cloud classification?","Question",{"text":74,"@type":75},"It targets the challenge of obtaining classifications that match specific user needs, which is difficult when humans are not involved during learning. ImmersiveIML integrates human input to refine and verify classification outputs.","Answer",{"name":77,"@type":72,"acceptedAnswer":78},"How does the system enable interaction in large 3D point clouds?",{"text":79,"@type":75},"It uses 6-DOF controllers to support direct interaction in large point clouds via a minimal brushing technique. Users provide input subsets (P1 and P2) and the model learns from them for training and inference.",{"name":81,"@type":72,"acceptedAnswer":82},"What interaction loop leads to convergence toward the intended classification?",{"text":83,"@type":75},"The process iteratively compares the classification result with the user’s intent and lets the user refine the input. Through repeated interaction cycles, the workflow converges to an acceptable classification.","https://schema.org",{"og:url":51,"og:type":86,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":88,"canonical":51},"index,follow",{"doc_id":7,"site_id":23},{"code":4,"msg":5,"data":91},[92,96,100,104,109,112,117,122,127,130,134],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":93,"show_sort_weight":94,"slug":95},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":97,"show_sort_weight":98,"slug":99},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":101,"show_sort_weight":102,"slug":103},"Exam",70,"exam",{"id":105,"doc_module":4,"doc_module_name":45,"category_name":106,"show_sort_weight":107,"slug":108},5,"Comic",60,"comic",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":110,"slug":111},50,"technology",{"id":113,"doc_module":4,"doc_module_name":45,"category_name":114,"show_sort_weight":115,"slug":116},7,"Healthcare",40,"healthcare",{"id":118,"doc_module":4,"doc_module_name":45,"category_name":119,"show_sort_weight":120,"slug":121},8,"Research & Report",30,"research-report",{"id":123,"doc_module":4,"doc_module_name":45,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":45,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":45,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":45,"category_name":136,"show_sort_weight":105,"slug":137},19,"General","general"]