Spatial Computing & 3D Interaction

Collaboration in XR

XR Collaboration in the ISUE Lab has focused on the use of natural input modalities from human users to collaborate with other users or machines to achieve common goals. Recently, we have defined a classification taxonomy for human-centered XR collaborative tasks, and also focused on investigating how users naturally communicate in VR assembly settings. Future research is focused on how users naturally interact with systems to complete tasks for them.

Tasks of these sort may be classified based on two main types of attributes; actions and properties. Actions refer to the possible functionalities that a task allows a user to perform in the task. This includes object manipulation, environmental perception, navigation, etc. Properties refer to the qualities of a specific task; do users collaborate synchronously or asynchronously (or both), are there any requirements to perform the task such as knowledge required, the type(s) of environments that the tasks are completed in, etc. The taxonomy serves as a classification system with many defining characteristics, other important properties/available actions that a task possesses may also be included in future work to further elaborate the nature of a task.

Collaboration using known natural communication conventions tends to improve the quality of collaboration between users; knowing how to facilitate such communication furthers task success and presence with other users. Research on the use of natural communication in VR assembly by Ghamandi et al. shows that voice, along with gaze in addition, helps to improve collaboration quality and performance.

Publications

AR/VR Interaction Techniques

Publications