Evaluating Navigation and Comparison Performance of Computational Notebooks on Desktop and in Virtual Reality
At-a-Glance 👀
We aimed to experiment with adapting computational notebooks into VR and verify the potential benefits VR can bring. We focus on the navigation and comparison aspects as they are primitive components in analysts' workflow. To further improve comparison, we have designed and implemented a Branching&Merging functionality. We tested computational notebooks on the desktop and in VR, both with and without the added Branching&Merging capability. We found VR significantly facilitated navigation compared to desktop, and the ability to create branches enhanced comparison.
Motivation 🤔
As computational notebooks become more complex, navigating and comparing analytical workflows in traditional desktop environments presents significant challenges. Analysts often struggle with linear execution, inefficient navigation, and limited comparison capabilities.
Solution 💡 (Click here for the demo video)
We developed an immersive computational notebook that extends traditional desktop notebooks into VR, enabling enhanced navigation and comparison workflows. A key feature of our system is the Branch & Merge functionality, which allows users to create, explore, and compare multiple analysis paths more efficiently in an immersive environment.
Process ⚙️
To evaluate the effectiveness of ICoN, we conducted a controlled user study comparing computational notebooks in both VR and desktop environments, with and without the Branch & Merge feature.
20 Participants performed navigation and comparison tasks, and
we analyzed both performance metrics (quantitative) and user feedback (qualitative).
Our findings show that VR significantly improves navigation, while the Branch & Merge feature enhances comparison tasks despite VR’s challenges with text input.
Product Successes 👏
The paper has been published in ACM CHI 2024, one of the best conferences in data visualization!