Breaking The Experience: Effects of Questionnaires in VR User Studies

Putze, S; Alexandrovsky, D; Putze, F; Hoeffner, S; Smeddinck, JD; Malaka, R

doi:10.1145/3313831.3376144

Breaking The Experience: Effects of Questionnaires in VR User Studies

Lookup NU author(s): Dr Jan Smeddinck ORCiD

Downloads

Accepted version [.pdf]

Licence

This is the authors' accepted manuscript of a conference proceedings (inc. abstract) that has been published in its final definitive form by Association for Computing Machinery, 2020.

For re-use rights please refer to the publisher's terms and conditions.

Abstract

Questionnaires are among the most common research tools in virtual reality (VR) evaluations and user studies. However, transitioning from virtual worlds to the physical world to respond to VR experience questionnaires can potentially lead to systematic biases. Administering questionnaires in VR (inVRQs) is becoming more common in contemporary research. This is based on the intuitive notion that inVRQs may ease participation, reduce the Break in Presence (BIP) and avoid biases. In this paper, we perform a systematic investigation into the effects of interrupting the VR experience through questionnaires using physiological data as a continuous and objective measure of presence. In a user study (n=50), we evaluated question-asking procedures using a VR shooter with two different levels of immersion. The users rated their player experience with a questionnaire either inside or outside of VR. Our results indicate a reduced BIP for the employed inVRQ without affecting the self-reported player experience.