Project Description
Presence, as a psychological state, is typically assessed using questionnaires. While many researchers in this field assume that these self-report instruments are standardized, the reliability of such questionnaires remains uncertain. This knowledge gap challenges the accuracy and validity of data derived from studies assessing presence. Ensuring reliable and precise data collection and reporting is essential for the credibility of findings in presence research, as inaccuracies or inconsistencies can lead to erroneous conclusions, impacting theoretical understandings, methodological approaches, and practical applications. To address this issue, we conducted a systematic analysis of 397 empirical quantitative studies on presence. We investigated the use of presence scales, including applications, modifications, a variety of measures and reporting practices. We found that the majority of the presence studies modify questionnaires, do not re-validate them, and improperly report their methods. Based on these findings, we propose solutions to enhance transparency and validation of the presence measurements.
Video
Related Publications
- Kukshinov, E., Tu, J., Szita, K., Senthil Nathan, K., & Nacke, L. E. (2024, May). " Never The Same": Systematic Analysis of the Methodological Issues in the Presence Studies That Employ Questionnaires. In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (pp. 1-7).
https://dl.acm.org/doi/10.1145/3613905.3651074