AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented Reality
This program is tentative and subject to change.
With the advents in geometry perception and Augmented Reality (AR), end-users can customize Tangible User Interfaces (TUIs) that control digital assets using intuitive and comfortable interactions with physical geometries (e.g., edges and surfaces). However, it remains challenging to adapt such TUIs in varied physical environments while maintaining the same spatial and ergonomic affordance. We propose AdapTUI, an end-to- end system that enables an end-user to author geometric-based TUIs and automatically adapts the TUIs when the user moves to a new environment. Leveraging a geometry detection module and the spatial awareness of AR, AdapTUI first lets users create custom mappings between geometric features and digital functions. Then, AdapTUI uses an optimization-based adaptation framework, which considers both the geometric variations and human-factor nuances, to dynamically adjust the attachment of the user-authored TUIs.
We demonstrate three application scenarios where end-users can utilize TUIs at different locations, including portable car play, efficient AR workstation, and entertainment. We evaluated the effectiveness of the adaptation method as well as the overall usability through a comparison user study (N=12). The satisfactory adaptation of the user-authored TUIs and the positive qualitative feedback demonstrate the effectiveness of our system.
This program is tentative and subject to change.
Wed 30 OctDisplayed time zone: Pacific Time (US & Canada) change
11:15 - 12:30 | |||
11:15 18mTalk | MoiréTag: A Low-Cost Tag for High-Precision Tangible Interactions without Active Components Papers Peiyu Zhang University of Virginia, Wen Ying University of Virginia, Sara Riggs University of Virginia, Seongkook Heo University of Virgina DOI | ||
11:33 18mTalk | AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented Reality Papers Fengming He Purdue University, Xiyun Hu Purdue University, Xun Qian Google, Zhengzhe Zhu Purdue University, Karthik Ramani Purdue University DOI Media Attached | ||
11:52 18mTalk | Audio-Vibratory You-Are-Here Mobile Maps for People with Visual Impairments Papers Elen Sargsyan University of Toulouse 3, IRIT, Bernard Oriola CNRS, Marcos Serrano IRIT - University Toulouse, Christophe Jouffrais CNRS DOI |