A Systematic Review of user interaction with virtual reality environment and the relationship of it with architecture

Document Type : Original Article

Authors
1 Assistant Professor, Department of Architecture, Rasht Branch, Islamic Azad University, Rasht, Iran
2 Architectural Department, Rasht branch, Ph.D. student, Islamic Azad university, Rasht, Iran
Abstract
Virtual reality technology as a new technology allows users to experience a simulated environment that is similar to a real environment. These systems include different types of interaction with users; therefore, it is possible to identify the principles and solutions of producing an interactive virtual environment, especially in the field of architecture. The importance of creating interaction between the user and the simulated environment in this area is effective in the better understanding of the users of the environment and paying attention to the problem under study, as a result of which we can point to more accurate findings and more valid results. The process of conducting this research was started by defining the general scope of this research which is "user interaction in virtual reality environment" and by examining related keywords, articles were collected in line with this topic and after the final selection, 39 articles were reviewed. Finally, it can be said that virtual reality technology has various applications in various fields such as construction industry, medicine, education, maintenance and other fields. Regarding the connection of this technology with design and architecture as the main concern of this research, this technology increases cooperation and interaction between the members of the design groups and the audience through the capabilities of the simulated virtual environment, and this connection is based on the knowledge of 4 components: 1- users, 2- devices, 3- user activity and 4- evaluation method, as effective factors in creating an effective interactive environment in virtual reality technology.
Keywords

 
Abdelhameed, W. A. (2013). Virtual Reality Use in Architectural Design Studios: A case of studying structure and construction. Procedia Computer Science, 25, 220-230.
Abich, J., Parker, J., Murphy, J. S., & Eudy, M. (2021). A review of the evidence for training effectiveness with virtual reality technology. Virtual Reality, 25(4), 919-933. doi:10.1007/s10055-020-00498-8
Anton, D., Kurillo, G., & Bajcsy, R. (2018). User experience and interaction performance in 2D/3D telecollaboration. Future Generation Computer Systems, 82, 77-88. doi:https://doi.org/10.1016/j.future.2017.12.055
Baus, O., & Bouchard, S. (2017). Exposure to an unpleasant odour increases the sense of presence in virtual reality. Virtual Reality, 21, 59-74.
Bian, Y., Yang, C., Gao, F., Li, H., Zhou, S., Li, H., . . . Meng, X. (2016). A framework for physiological indicators of flow in VR games: construction and preliminary evaluation. Personal and Ubiquitous Computing, 20, 821-832.
Bouchlaghem, D., Shang, H., Whyte, J., & Ganah, A. (2005). Visualisation in architecture, engineering and construction (AEC). Automation in Construction, 14(3), 287-295. doi:https://doi.org/10.1016/j.autcon.2004.08.012
Bowman, D. A., Kruijff, E., LaViola, J. J., Jr., & Poupyrev, I. (2001). An Introduction to 3-D User Interface Design. Presence: Teleoperators and Virtual Environments, 10(1), 96-108. doi:10.1162/105474601750182342
Brade, J., Lorenz, M., Busch, M., Hammer, N., Tscheligi, M., & Klimant, P. (2017). Being there again–Presence in real and virtual environments and its relation to usability and user experience using a mobile navigation task. International Journal of Human-Computer Studies, 101, 76-87.
Cobb, S. V. G., Nichols, S., Ramsey, A., & Wilson, J. R. (1999). Virtual Reality-Induced Symptoms and Effects (VRISE). Presence: Teleoperators and Virtual Environments, 8(2), 169-186. doi:10.1162/105474699566152
Culbertson, H., & Kuchenbecker, K. J. (2017). Importance of Matching Physical Friction, Hardness, and Texture in Creating Realistic Haptic Virtual Surfaces. IEEE Transactions on Haptics, 10(1), 63-74. doi:10.1109/TOH.2016.2598751
de Jesus Oliveira, V. A., Nedel, L., & Maciel, A. (2018). Assessment of an articulatory interface for tactile intercommunication in immersive virtual environments. Computers & Graphics, 76, 18-28.
Feng, Y., Duives, D. C., & Hoogendoorn, S. P. (2022). Wayfinding behaviour in a multi-level building: A comparative study of HMD VR and Desktop VR. Advanced Engineering Informatics, 51, 101475. doi:https://doi.org/10.1016/j.aei.2021.101475
Forlizzi, J., & Battarbee, K. (2004). Understanding experience in interactive systems. Paper presented at the Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques, Cambridge, MA, USA. https://doi.org/10.1145/1013115.1013152
Hartson, R., & Pyla, P. S. (2012). The UX Book: Process and guidelines for ensuring a quality user experience: Elsevier.
Hepperle, D., Weiß, Y., Siess, A., & Wölfel, M. (2019). 2D, 3D or speech? A case study on which user interface is preferable for what kind of object interaction in immersive virtual reality. Computers & Graphics, 82, 321-331. doi:https://doi.org/10.1016/j.cag.2019.06.003
Howard, M. C. (2017). A meta-analysis and systematic literature review of virtual reality rehabilitation programs. Computers in Human Behavior, 70, 317-327. doi:https://doi.org/10.1016/j.chb.2017.01.013
Jayaram, S., Connacher, H. I., & Lyons, K. W. (1997). Virtual assembly using virtual reality techniques. Computer-Aided Design, 29(8), 575-584. doi:https://doi.org/10.1016/S0010-4485(96)00094-2
Jerald, J. (2015). The VR Book: Human-Centered Design for Virtual Reality: Association for Computing Machinery and Morgan & Claypool.
Jerald, J. (2018). Human-Centered VR Design: Five Essentials Every Engineer Needs to Know. IEEE Computer Graphics and Applications, 38(2), 15-21. doi:10.1109/MCG.2018.021951628
Kageyama, A., & Tomiyama, A. (2016). Visualization framework for CAVE virtual reality systems. International Journal of Modeling, Simulation, and Scientific Computing, 7(04), 1643001.
Kim, Y. M., Rhiu, I., & Yun, M. H. (2020). A Systematic Review of a Virtual Reality System from the Perspective of User Experience. International Journal of Human–Computer Interaction, 36(10), 893-910. doi:10.1080/10447318.2019.1699746
Kober, S. E., & Neuper, C. (2013). Personality and presence in virtual reality: Does their relationship depend on the used presence measure? International Journal of Human-Computer Interaction, 29(1), 13-25.
Koutsabasis, P., & Vosinakis, S. (2018). Kinesthetic interactions in museums: conveying cultural heritage by making use of ancient tools and (re-) constructing artworks. Virtual Reality, 22(2), 103-118. doi:10.1007/s10055-017-0325-0
Kozhevnikov, M., & Gurlitt, J. (2013). Immersive and non-immersive virtual reality system to learn relative motion concepts. Paper presented at the 2013 3rd Interdisciplinary Engineering Design Education Conference.
Kyriakou, M., Pan, X., & Chrysanthou, Y. (2017). Interaction with virtual crowd in Immersive and semi‐Immersive Virtual Reality systems. Computer Animation and Virtual Worlds, 28(5), e1729.
Li, X., Yi, W., Chi, H.-L., Wang, X., & Chan, A. P. C. (2018). A critical review of virtual and augmented reality (VR/AR) applications in construction safety. Automation in Construction, 86, 150-162. doi:https://doi.org/10.1016/j.autcon.2017.11.003
Lin, Y., Breugelmans, J., Iversen, M., & Schmidt, D. (2017). An Adaptive Interface Design (AID) for enhanced computer accessibility and rehabilitation. International Journal of Human-Computer Studies, 98, 14-23. doi:https://doi.org/10.1016/j.ijhcs.2016.09.012
Monteiro, P., Carvalho, D., Melo, M., Branco, F., & Bessa, M. (2018). Application of the steering law to virtual reality walking navigation interfaces. Computers & Graphics, 77, 80-87.
Muhanna, M. A. (2015). Virtual reality and the CAVE: Taxonomy, interaction challenges and research directions. Journal of King Saud University - Computer and Information Sciences, 27(3), 344-361. doi:https://doi.org/10.1016/j.jksuci.2014.03.023
Muhanna, M. A. (2015). Virtual reality and the CAVE: Taxonomy, interaction challenges and research directions. Journal of King Saud University-Computer and Information Sciences, 27(3), 344-361.
Narciso, D., Bessa, M., Melo, M., Coelho, A., & Vasconcelos-Raposo, J. (2019). Immersive 360 video user experience: impact of different variables in the sense of presence and cybersickness. Universal Access in the Information Society, 18(1), 77-87. doi:10.1007/s10209-017-0581-5
Oprea, S., Martinez-Gonzalez, P., Garcia-Garcia, A., Castro-Vargas, J. A., Orts-Escolano, S., & Garcia-Rodriguez, J. (2019). A visually realistic grasping system for object manipulation and interaction in virtual reality environments. Computers & Graphics, 83, 77-86. doi:https://doi.org/10.1016/j.cag.2019.07.003
Oprean, D., Simpson, M., & Klippel, A. (2017). Collaborating remotely: an evaluation of immersive capabilities on spatial experiences and team membership. International Journal of Digital Earth, 11, 1-17. doi:10.1080/17538947.2017.1381191
Pedroli, E., Greci, L., Colombo, D., Serino, S., Cipresso, P., Arlati, S., . . . Gaggioli, A. (2018). Characteristics, Usability, and Users Experience of a System Combining Cognitive and Physical Therapy in a Virtual Environment: Positive Bike. Sensors, 18(7), 2343.
Pick, S., Weyers, B., Hentschel, B., & Kuhlen, T. W. (2016). Design and Evaluation of Data Annotation Workflows for CAVE-like Virtual Environments. IEEE Trans Vis Comput Graph, 22(4), 1452-1461. doi:10.1109/tvcg.2016.2518086
Portman, M. E., Natapov, A., & Fisher-Gewirtzman, D. (2015). To go where no man has gone before: Virtual reality in architecture, landscape architecture and environmental planning. Computers, Environment and Urban Systems, 54, 376-384. doi:https://doi.org/10.1016/j.compenvurbsys.2015.05.001
Reyes-Lecuona, A., & Diaz-Estrella, A. (2006). New interaction paradigms in virtual environments. Paper presented at the MELECON 2006-2006 IEEE Mediterranean Electrotechnical Conference.
Riecke, B. E., Schulte-Pelkum, J., Caniard, F., & Bulthoff, H. H. (2005). Towards lean and elegant self-motion simulation in virtual reality. Paper presented at the IEEE Proceedings. VR 2005. Virtual Reality, 2005.
Roto, V., Law, E., Vermeeren, A., & Hoonhout, J. (2011). Bringing clarity to the concept of user experience. Paper presented at the Result from Dagstuhl Seminar on Demarcating User Experience.
Safikhani, S., Keller, S., Schweiger, G., & Pirker, J. (2022). Immersive virtual reality for extending the potential of building information modeling in architecture, engineering, and construction sector: systematic review. International Journal of Digital Earth, 15(1), 503-526. doi:10.1080/17538947.2022.2038291
Schuemie, M. J., van der Straaten, P., Krijn, M., & van der Mast, C. A. (2001). Research on presence in virtual reality: a survey. Cyberpsychol Behav, 4(2), 183-201. doi:10.1089/109493101300117884
Schulze, K., & Krömker, H. (2010). A framework to measure user experience of interactive online products. Paper presented at the Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research, Eindhoven, The Netherlands. https://doi.org/10.1145/1931344.1931358
Sidani, A., Dinis, F. M., Duarte, J., Sanhudo, L., Calvetti, D., Baptista, J. S., . . . Soeiro, A. (2021). Recent tools and techniques of BIM-Based Augmented Reality: A systematic review. Journal of Building Engineering, 42, 102500.
Takatalo, J., Nyman, G., & Laaksonen, L. (2008). Components of human experience in virtual environments. Computers in Human Behavior, 24(1), 1-15. doi:https://doi.org/10.1016/j.chb.2006.11.003
Thüring, M., & Mahlke, S. (2007). Usability, aesthetics and emotions in human–technology interaction. International Journal of Psychology, 42(4), 253-264. doi:https://doi.org/10.1080/00207590701396674
Turchet, L., Burelli, P., & Serafin, S. (2013). Haptic Feedback for Enhancing Realism of Walking Simulations. IEEE Transactions on Haptics, 6(1), 35-45. doi:10.1109/TOH.2012.51
Tussyadiah, I. P., Wang, D., Jung, T. H., & tom Dieck, M. C. (2018). Virtual reality, presence, and attitude change: Empirical evidence from tourism. Tourism Management, 66, 140-154. doi:https://doi.org/10.1016/j.tourman.2017.12.003
Vinnikov, M., Allison, R. S., & Fernandes, S. (2017). Gaze-contingent auditory displays for improved spatial attention in virtual reality. ACM Transactions on Computer-Human Interaction (TOCHI), 24(3), 1-38.
Wang, J., & Lindeman, R. (2015). Coordinated hybrid virtual environments: Seamless interaction contexts for effective virtual reality. Computers & Graphics, 48, 71-83. doi:https://doi.org/10.1016/j.cag.2015.02.007
Wang, P., Wu, P., Wang, J., Chi, H.-L., & Wang, X. (2018). A Critical Review of the Use of Virtual Reality in Construction Engineering Education and Training. International Journal of Environmental Research and Public Health, 15(6), 1204.
Yung, R., & Khoo-Lattimore, C. (2017). New realities: a systematic literature review on virtual reality and augmented reality in tourism research. Current Issues in Tourism, 22, 1-26. doi:10.1080/13683500.2017.1417359
Zhang, H. (2017). Head-mounted display-based intuitive virtual reality training system for the mining industry. International Journal of Mining Science and Technology, 27(4), 717-722. doi:https://doi.org/10.1016/j.ijmst.2017.05.005