[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-seo-674358-105":3,"detail-sidebar-cat-0-en-105":79,"doc-detail-674358-en":129},{"code":4,"msg":5,"data":6},0,"ok",{"site_id":7,"language":8,"slug":9,"title":10,"keywords":11,"description":12,"schema_data":13,"social_meta":72,"head_meta":74,"extra_data":76,"updated_unix":78},105,"en","look-turn-one-handed-and-expressive-menu-interaction-by-gaze-and-arm-turns-in-vr","Look & Turn - One-handed and Expressive Menu Interaction by Gaze and Arm Turns in VR","","A user’s free hands enable intuitive virtual menu placement and interaction, motivating hand-attached menu designs that integrate eyes and hands. The work synthesizes prior literature to define a design space combining menu-system properties with an eye-and-hand input vocabulary. It proposes three menu systems based on Look & Turn: gaze selects, while wrist/arm rotation navigates and manipulates continuous parameters, keeping the other hand free for drawing. A VR prototype using eye tracking and glove finger tracking supports initial technical and human-factors insights.",{"@graph":14,"@context":71},[15,34,54],{"@type":16,"itemListElement":17},"BreadcrumbList",[18,23,27,31],{"item":19,"name":20,"@type":21,"position":22},"https://docshare.wps.com","Home","ListItem",1,{"item":24,"name":25,"@type":21,"position":26},"https://docshare.wps.com/document/","Document",2,{"item":28,"name":29,"@type":21,"position":30},"https://docshare.wps.com/document/technology/","Technology",3,{"item":32,"name":10,"@type":21,"position":33},"https://docshare.wps.com/document/look-turn-one-handed-and-expressive-menu-interaction-by-gaze-and-arm-turns-in-vr/674358/",4,{"url":32,"name":10,"@type":35,"image":36,"author":41,"headline":10,"publisher":44,"fileFormat":47,"inLanguage":8,"description":12,"dateModified":48,"datePublished":48,"encodingFormat":47,"isAccessibleForFree":49,"interactionStatistic":50},"DigitalDocument",{"url":37,"@type":38,"width":39,"height":40},"https://docshare.wps.com/thumbnails/look-turn-one-handed-and-expressive-menu-interaction-by-gaze-and-arm-turns-in-vr/674358.png","ImageObject",300,407,{"name":42,"@type":43},"Syukur Setiap Hari","Person",{"url":19,"name":45,"@type":46},"DocShare","Organization","application/pdf","2026-11-04",true,{"@type":51,"interactionType":52,"userInteractionCount":4},"InteractionCounter",{"@type":53},"ViewAction",{"@type":55,"mainEntity":56},"FAQPage",[57,63,67],{"name":58,"@type":59,"acceptedAnswer":60},"What is the Look & Turn interaction concept in the paper?","Question",{"text":61,"@type":62},"Look & Turn combines gaze for implicit selection of menu groups and items with arm-turn (plus pinch) to navigate the menu and manipulate continuous parameters.","Answer",{"name":64,"@type":59,"acceptedAnswer":65},"How does the proposed approach support one-handed interaction?",{"text":66,"@type":62},"Users interact with the hand-attached menu using the same hand, while the other hand remains free for drawing, avoiding the need for both hands during menu use.",{"name":68,"@type":59,"acceptedAnswer":69},"What VR prototype and tracking methods are used to evaluate the concept?",{"text":70,"@type":62},"The work discusses first insights from a VR prototype that combines eye-tracking with glove-based finger tracking to realize the interaction techniques.","https://schema.org",{"og:url":32,"og:type":73,"og:title":10,"og:site_name":45,"og:description":12},"article",{"robots":75,"canonical":32},"index,follow",{"doc_id":77,"site_id":7},674358,1793761141,{"code":4,"msg":80,"data":81},"success",[82,86,90,94,99,103,108,113,118,121,125],{"id":22,"doc_module":4,"doc_module_name":25,"category_name":83,"show_sort_weight":84,"slug":85},"Story & Novel",90,"story-novel",{"id":26,"doc_module":4,"doc_module_name":25,"category_name":87,"show_sort_weight":88,"slug":89},"Literature",80,"literature",{"id":33,"doc_module":4,"doc_module_name":25,"category_name":91,"show_sort_weight":92,"slug":93},"Exam",70,"exam",{"id":95,"doc_module":4,"doc_module_name":25,"category_name":96,"show_sort_weight":97,"slug":98},5,"Comic",60,"comic",{"id":100,"doc_module":4,"doc_module_name":25,"category_name":29,"show_sort_weight":101,"slug":102},6,50,"technology",{"id":104,"doc_module":4,"doc_module_name":25,"category_name":105,"show_sort_weight":106,"slug":107},7,"Healthcare",40,"healthcare",{"id":109,"doc_module":4,"doc_module_name":25,"category_name":110,"show_sort_weight":111,"slug":112},8,"Research & Report",30,"research-report",{"id":114,"doc_module":4,"doc_module_name":25,"category_name":115,"show_sort_weight":116,"slug":117},9,"Religion & Spirituality",20,"religion-spirituality",{"id":116,"doc_module":4,"doc_module_name":25,"category_name":119,"show_sort_weight":116,"slug":120},"World Cup","world-cup",{"id":122,"doc_module":4,"doc_module_name":25,"category_name":123,"show_sort_weight":122,"slug":124},10,"Lifestyle","lifestyle",{"id":126,"doc_module":4,"doc_module_name":25,"category_name":127,"show_sort_weight":95,"slug":128},19,"General","general",{"code":4,"msg":80,"data":130},{"doc_id":77,"user_id":131,"nickname":42,"user_avatar":132,"doc_module":4,"category_id":100,"category_name":29,"doc_title":10,"doc_description":12,"doc_content":133,"file_id":134,"file_url":135,"file_type":136,"file_size":137,"view_count":4,"is_deleted":4,"is_public":22,"is_downloadable":22,"audit_status":22,"page_count":104,"language":138,"language_code":8,"site_id":7,"html_lang":8,"table_of_contents":139,"faqs":140,"seo_title":141,"seo_description":12,"update_tm":78,"read_time":142},962093541965,"https://ap-avatar.wpscdn.com/davatar_276721f389ce27ea32af1340a28f341c","Look & Turn: One-handed and Expressive Menu Interaction by  \nGaze and Arm Turns in VR  \nKatharina Reiter  \n[katharina.reiter1@stud.sbg.ac.at](katharina.reiter1@stud.sbg.ac.at)[ ](katharina.reiter1@stud.sbg.ac.at)Paris London Universität Salzburg Salzburg, Austria  \nKen Pfeuffer  \n[ken@cs.au.dk](ken@cs.au.dk)[ ](ken@cs.au.dk)Aarhus University Aarhus, Denmark Bundeswehr University Munich Munich, Germany  \nAugusto Esteves  \n[augusto.esteves@tecnico.ulisboa.pt](augusto.esteves@tecnico.ulisboa.pt)[ ](augusto.esteves@tecnico.ulisboa.pt)[ITI / LARSyS](ITI / LARSyS), [Instituto Superior](Instituto Superior)[ ](Instituto Superior)Técnico, University of Lisbon Lisbon, Portugal  \nTim Mittermeier  \n[tim.mittermeier@unibw.de](tim.mittermeier@unibw.de)[ ](tim.mittermeier@unibw.de)Bundeswehr University Munich Munich, Germany  \nFlorian Alt  \n[florian.alt@unibw.de](florian.alt@unibw.de)[ ](florian.alt@unibw.de)Bundeswehr University Munich Munich, Germany  \nFigure 1: We explore design and interaction of handheld menu for freehand gestural Virtual Reality (VR). Specifically, how to hold and interact with the menu via just a single hand and gaze – keeping the other hand free for drawing. Example: The user looks at a menu sub-group (b), and then rotates the arm to adjust a parameter (c), to then immediately continue drawing with the dominant hand (d).  \nABSTRACT  \nA user’s free hands provide an intuitive platform to position and design virtual menu interfaces. We explore how the hands and eyes can be integrated in the design of hand-attached menus. We synthesise past work from the literature and derive a design space that crosses properties of menu systems with an hand and eye input vocabulary. From this, we devise three menu systems that are based on the novel concept of Look & Turn: gaze indicates menu selection, and rotational turn of the wrist navigates menu and manipulates continuous parameters. Each technique allows users to interact with the hand-attached menu using the same hand, while keeping the other hand free for drawing. Based on a VR prototype that combines eye-tracking and glove-based finger tracking, we discuss first insights on technical and human factors of the promising interaction concept.  \nPermission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions [from permissions@acm.org](from permissions@acm.org).  \nETRA’22, June 8–11, 2022, Seattle, WA, USA © 2022 Association for Computing Machinery.  \nACM ISBN 978-1-4503-9252-5/22/06. . . $15.00 [https://doi.org/10.1145/3517031.3529233](https://doi.org/10.1145/3517031.3529233)  \nCCS CONCEPTS  \n• Human-centered computing → Interaction techniques; Virtual reality; Interaction design.  \nKEYWORDS  \nMultimodal interaction, virtual reality, VR, gaze interaction, handheld menus, on-body menus, extended reality, XR  \nACM Reference Format:  \nKatharina Reiter, Ken Pfeuffer, Augusto Esteves, Tim Mittermeier, and Florian Alt. 2022. Look & Turn: One-handed and Expressive Menu Interaction by Gaze and Arm Turns in VR. In 2022 Symposium on Eye Tracking Research and Applications (ETRA’22), June 8–11, 2022, Seattle, WA, USA. ACM, New York, NY, USA, 7 pages. [https://doi.org/10.1145/3517031.3529233](https://doi.org/10.1145/3517031.3529233)  \n1 INTRODUCTION  \nAs spatial interfaces grow in popularity through Virtual and Augmented Reality (VR/AR), exploring novel ways in which users can interact with these systems is important [Billinghurst et al. 2015] . Gestural interfaces controlled by free hands of the user are promising fo","cbCain2iZT0Qbyc6","https://ap.wps.com/l/cbCain2iZT0Qbyc6","pdf",876508,"English","# ABSTRACT\n# 1 INTRODUCTION","[{\"question\":\"What is the Look \\u0026 Turn interaction concept in the paper?\",\"answer\":\"Look \\u0026 Turn combines gaze for implicit selection of menu groups and items with arm-turn (plus pinch) to navigate the menu and manipulate continuous parameters.\"},{\"question\":\"How does the proposed approach support one-handed interaction?\",\"answer\":\"Users interact with the hand-attached menu using the same hand, while the other hand remains free for drawing, avoiding the need for both hands during menu use.\"},{\"question\":\"What VR prototype and tracking methods are used to evaluate the concept?\",\"answer\":\"The work discusses first insights from a VR prototype that combines eye-tracking with glove-based finger tracking to realize the interaction techniques.\"}]","Look & Turn - One-handed and Expressive Menu Interaction by Gaze and Arm Turns in VR | PDF",18]