HandPad: 双手交互界面用于VR中的流畅窗口交互

Jul 16, 2026

Upload by Ophelia

Virtual Reality (VR) enables mobile productivity through expansive displays, but current systems depend on external inputs that limit portability and precision for 2D information work. HandPad introduces a device-free suite of bare-hand techniques built on asymmetric bimanual coordination and self-haptic support. The non-dominant hand sets spatial frames and interaction contexts, while the dominant hand performs fine-grained manipulation. NDH gestures switch modes and targets, supporting multi-window navigation, in-window content interaction, and window management.

LanguageEnglish

CategoryTechnology

FormatPDF

Pages12

Reading Time30 min

Introduction

Motivation and productivity constraints

Limitations of conventional VR inputs

Asymmetric bimanual interaction rationale

HandPad interaction techniques and modes

HandPad: A Bimanual Hand Interface for Fluid Window Interactions in VR Wen Ying 1 , Adil Rahman 1 , Erzhen Hu 1 , and Seongkook Heo2 1 Department of Computer Science, University of Virginia 2 Department of Computer Science and Engineering, Ulsan National Institute of Science and Technology arXiv :2607 . 11807v1 [ cs .HC] 13 Jul 2026 Project page: [https://handpad.github.io/](https://handpad.github.io/) Figure 1: HandPad utilizes the non-dominant hand (NDH) to establish spatial frames and interaction contexts, enabling the dominant hand (DH) to perform fine-grained manipulations. (a) Semi-Snap: A slightly bent NDH gesture initiates an interaction window, serving as a spatial reference for navigating between applications. (b) Snap: A Flat NDH fixes the interaction window, enabling the DH to perform direct and precise interactions on the palm. (c) Over-Snap: A widely open NDH transitions the system to coarsegrained application management. Users can adjust window orientation via NDH rotation and relocate the window using DH pinch gestures. Both physical hands are remapped to the virtual window to mimic direct manipulation while improving ergonomics. ABSTRACT Virtual Reality (VR) offers potential for productivity work by creating expansive displays anywhere, yet current systems often rely on external input devices that limit the on-the-go use of mobile VR. We introduce HandPad, a suite of bare-hand interaction techniques that leverage the benefits of asymmetric bimanual coordination and selfhaptic support. HandPad assigns the non-dominant hand (NDH) to establish spatial frames and interaction contexts, while the dominant hand (DH) performs fine-grained manipulation. Users can use NDH gestures as an input modifier to change the mode and target of DH interactions, including multi-window navigation, in-window content interaction, and window management. The palm surface of the NDH also serves as a physical touch surface, providing passive haptic feedback for effective DH touch interaction. Both hands and their interactions are spatially remapped to the window surface, enabling comfortable and direct interaction with virtual content. An exploratory study showed that HandPad enables efficient and ergonomic interaction, demonstrating its potential as a device-free approach for knowledge work in VR. Index Terms: Gestures, bimanual interaction, input remapping, virtual reality. 1 INTRODUCTION Virtual Reality (VR) opens new possibilities for productivity work, offering customized environments that transcend physical constraints such as limited display and ambient noise [1, 2] . However, standard VR inputs, such as gaze, controllers or in-air gestures, often lack the precision and haptic feedback required for information work on 2D windows [3, 4] . While researchers have in- tegrated conventional input tools like mice or tablets into VR [5, 6], these hardware-dependent solutions often reduce portability in mobile VR settings and are difficult to adapt to versatile spatial displays [7] . Overall, efficiently interacting with large, multi-window environments without dedicated hardware remains a critical challenge for the on-the-go use of mobile VR. Advances in hand tracking have integrated bare-hand interaction into commercial headsets like the Meta Quest 3 and Apple Vision Pro; however, these systems typically assign both hands identical functions, overlooking the dexterity and specialized manual roles of the two hands [8] . In practice, interacting with virtual windows is a joint activity that requires both stability and precision, a coordination that can benefit from asymmetric bimanual interaction [9] . In this model, the non-dominant hand (NDH) establishes the spatial frame and interaction context, while the dominant hand (DH) performs fine-grained actions and detailed content manipulation relative to that established reference [9, 10] . However, standard touch interfaces often struggle to support such asymmetric

FAQs

HandPad如何在VR中实现更流畅的窗口交互？

HandPad使用非优势手建立空间框架与交互情境，优势手在该参考下进行精细操作。用户通过非优势手手势切换模式与目标，从而完成多窗口导航、窗口内交互与窗口管理。

非优势手（NDH）在HandPad中承担哪些角色？

NDH用于建立空间框架与交互上下文，并在手势层面作为输入修饰符来改变优势手交互的模式与目标。NDH掌面还能作为物理触摸面，提供被动触觉反馈以支持优势手触控。

优势手（DH）主要负责什么交互？

DH负责相对NDH参考框架的精细操作与详细内容操控。通过与NDH的空间关系配合，DH可进行窗口内容操作与精确触控交互。

HandPad如何处理裸手交互常见的“gorilla arm”问题？

HandPad允许用户在更舒适的低物理位置进行操作，然后将手与输入在空间上重映射到更高的虚拟窗口，从而缓解手臂负担。

Jul 16, 2026

Upload by Ophelia