ACM ISS 2024
Sun 27 - Wed 30 October 2024
Tue 29 Oct 2024 09:37 - 09:56 at Theatre C300 - Paper Session 3: Gestures Chair(s): Tim Dwyer

Augmented video presentation tools provide a natural way for presenters to interact with their content, resulting in engaging experiences for remote audiences, such as when a presenter uses hand gestures to manipulate and direct attention to visual aids overlaid on their webcam feed. However, authoring and customizing these presentations can be challenging, particularly when presenting dynamic data visualization (i.e., animated charts). To this end, we introduce VisConductor, an authoring and presentation tool that equips presenters with the ability to configure gestures that control affect-varying visualization animation, foreshadow visualization transitions, direct attention to notable data points, and animate the disclosure of annotations. These gestures are integrated into configurable widgets, allowing presenters to trigger content transformations by executing gestures within widget boundaries, with feedback visible only to them. Altogether, our palette of widgets provides a level of flexibility appropriate for improvisational presentations and ad-hoc content transformations, such as when responding to audience engagement. To evaluate VisConductor, we conducted two studies focusing on presenters (𝑁=11) and audience members (𝑁=11). Our findings indicate that our approach taken with VisConductor can facilitate interactive and engaging remote presentations with dynamic visual aids. Reflecting on our findings, we also offer insights to inform the future of augmented video presentation tools.

Tue 29 Oct

Displayed time zone: Pacific Time (US & Canada) change

09:00 - 10:15
Paper Session 3: GesturesPapers at Theatre C300
Chair(s): Tim Dwyer Monash University
09:00
18m
Talk
GestureGPT: Toward Zero-Shot Free-Form Hand Gesture Understanding with Large Language Model AgentsBest PaperPresented Online
Papers
Xin Zeng Chinese Academy Of Sciences, Xiaoyu Wang The Hong Kong University of Science and Technology, Tengxiang Zhang Chinese Academy of Sciences, Chun Yu Tsinghua University, Shengdong Zhao City University of Hong Kong, Yiqiang Chen Chinese Academy of Sciences
DOI
09:18
18m
Talk
Hapstick-Figure: Investigating the Design of a Haptic Representation of Human Gestures from Theater Performances for Blind and Visually-Impaired PeoplePresented Online
Papers
Leyla Benhamida USTHB University, Slimane LARABI USTHB University, Oussama Metatla University of Bristol
DOI
09:37
18m
Talk
VisConductor: Affect-Varying Widgets for Animated Data Storytelling in Gesture-Aware Augmented Video Presentation
Papers
Temiloluwa Paul Femi-Gege University of Waterloo, Matthew Brehmer Tableau Research, Jian Zhao University of Waterloo
DOI Media Attached
09:56
18m
Talk
Gaze, Wall, and Racket: Combining Gaze and Hand-Controlled Plane for 3D Selection in Virtual Reality
Papers
Uta Wagner Aarhus University, Matthias Albrecht University of Konstanz, Andreas Asferg Jacobsen Aarhus University, Haopeng Wang Lancaster University, Hans Gellersen Lancaster University; Aarhus University, Ken Pfeuffer Aarhus University
DOI