This is the Table I Want!
Interactive Data Transformation on Desktop and in Virtual Reality
At-a-Glance 👀
We studied the potential benefits of direct interaction and virtual reality (VR) for data transformation. We compared gesture interaction vs. a standard WIMP user interface, each on the desktop and in VR. With the tested data and tasks, we found time performance was similar between desktop and VR. Meanwhile, VR demonstrates preliminary evidence to better support provenance and sense-making throughout the data transformation process.
Motivation 🤔
As computational notebooks become more complex, navigating and comparing analytical workflows in traditional desktop environments presents significant challenges. Analysts often struggle with linear execution, inefficient navigation, and limited comparison capabilities.
Solution 💡 (Click here for the demo video)
We developed an interactive data transformation system that integrates both desktop and VR environments, enabling direct manipulation of data through gestures. Our system allows users to perform essential data transformation operations using intuitive embodied interactions in VR and embedded gestures on the desktop, providing an alternative to traditional WIMP interfaces.
Process ⚙️
To evaluate the effectiveness of gesture-based interactions in VR and desktop environments, we conducted a controlled user study comparing four conditions: Desktop+WIMP, Desktop+Gesture, VR+WIMP, and VR+Gesture.
20 participants performed data transformation tasks across these conditions, and we analyzed task performance, user preferences, and cognitive load.
Our findings suggest that VR enhances provenance tracking and sense-making while gesture-based interactions provide an intuitive alternative to traditional UI-based methods.
Product Successes 👏
The paper has been published in IEEE TVCG 2023, one of the best conferences in data visualization!