ACM ISS 2024
Sun 27 - Wed 30 October 2024
Wed 30 Oct 2024 11:33 - 11:52 at Theatre C300 - Paper Session 6: Tangible/MultiModal UI Chair(s): Michael Wybrow

With the advents in geometry perception and Augmented Reality (AR), end-users can customize Tangible User Interfaces (TUIs) that control digital assets using intuitive and comfortable interactions with physical geometries (e.g., edges and surfaces). However, it remains challenging to adapt such TUIs in varied physical environments while maintaining the same spatial and ergonomic affordance. We propose AdapTUI, an end-to- end system that enables an end-user to author geometric-based TUIs and automatically adapts the TUIs when the user moves to a new environment. Leveraging a geometry detection module and the spatial awareness of AR, AdapTUI first lets users create custom mappings between geometric features and digital functions. Then, AdapTUI uses an optimization-based adaptation framework, which considers both the geometric variations and human-factor nuances, to dynamically adjust the attachment of the user-authored TUIs.

We demonstrate three application scenarios where end-users can utilize TUIs at different locations, including portable car play, efficient AR workstation, and entertainment. We evaluated the effectiveness of the adaptation method as well as the overall usability through a comparison user study (N=12). The satisfactory adaptation of the user-authored TUIs and the positive qualitative feedback demonstrate the effectiveness of our system.

Wed 30 Oct

Displayed time zone: Pacific Time (US & Canada) change

11:15 - 12:30
Paper Session 6: Tangible/MultiModal UIPapers at Theatre C300
Chair(s): Michael Wybrow Monash University
11:15
18m
Talk
MoiréTag: A Low-Cost Tag for High-Precision Tangible Interactions without Active ComponentsHonorable Mention
Papers
Peiyu Zhang University of Virginia, Wen Ying University of Virginia, Sara Riggs University of Virginia, Seongkook Heo University of Virgina
DOI
11:33
18m
Talk
AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented Reality
Papers
Fengming He Purdue University, Xiyun Hu Purdue University, Xun Qian Google, Zhengzhe Zhu Purdue University, Karthik Ramani Purdue University
DOI Media Attached
11:52
18m
Talk
Audio-Vibratory You-Are-Here Mobile Maps for People with Visual Impairments
Papers
Elen Sargsyan University of Toulouse 3, IRIT, Bernard Oriola CNRS, Marcos Serrano IRIT - University Toulouse, Christophe Jouffrais CNRS
DOI
12:11
18m
Talk
Don’t Block My Stuff: Fostering Personal Object Awareness in Multi-user Mixed Reality EnvironmentsPresented Online
Papers
Talha Khan University of Pittsburgh, David Lindlbauer Carnegie Mellon University
DOI