Enhancing the Realism of Virtual Construction Safety Training: Integration of Real-Time Location Systems for Real-World Hazard Simulations Kilian Speiser Technical University of Denmark, Denmark Kepeng Hong Technical University of Denmark, Denmark Jochen Teizer Technical University of Denmark, Denmark This is a section of CONVR 2023 - Proceedings of the 23rd International Conference on Construction Applications of Virtual Reality (DOI: 10.36253/979-12-215-0289-3) by Pietro Capone, Vito Getuli, Farzad Pour Rahimian, Nashwan Dawood, Alessandro Bruttini, Tommaso Sorbi Firenze University Press Florence 2023 https://doi.org/10.36253/10.36253/979-12-215-0289-3.15

Available for academic research purposes

Open Access

Copyright Author(s)

Content licence CC BY-NC 4.0

Metadata licence CC0 1.0

This is original content, published for academic research purposes

 Digital edition XML powered by Booksflow

In numerous studies, virtual training for construction safety has been proposed as a promising approach. However, creating realistic training scenarios requires significant resources, encompassing various elements such as sound, graphics, agent behavior, and realistic hazards. Digital Twins have revolutionized this process, and although so far, on a conceptual level only, significantly reducing the associated workload, it is still not exploiting its full potential. In this work, we propose a novel approach that leverages Real-time Location Systems (RTLS) data to simulate the real-world behavior of construction workers and equipment within Virtual Training Environments (VTEs). We aim to create training scenarios with dynamic real-world instead of hardcoded made-up hazardous events. To achieve this, we propose an extension to our Digital Twin for Construction Safety (DTCS) framework that now integrates (a) trajectory data streams of construction personnel and equipment and (b) technical specifications of the construction site work environment, including location and geometry of terrain and surface objects, to simulate real-world hazards in virtual safety training scenarios. Our further contribution is a case study application to explore the DTCS training capacity. Applying a logical filtering algorithm, we can process the RTLS data and ensure that the movements of the workers and equipment within the virtual environment are as realistic and representative as within the real world. This then enables the creation of realistic hazards that trainees can encounter in the training phase. Preliminary results with trainees suggest that the proposed work can have a high potential to enhance the realism of safety training, especially when they need to experience human-machine-related interactions safely. However, further work is required to create more responsive learning environments where the equipment follows real trajectories but also responds intelligently to the trainees' actions. By leveraging real-time data and advanced visualization technologies, we bridge the gap between the physical and virtual realms, enabling trainees to interact and navigate within a realistic virtual environment

 Construction Safety Digital Twins Education and Training Game Engines Internet of Things Learning Environments Mixed and Virtual Reality Real-Time-Location System Real-world Hazards

It is available online at https://doi.org/10.36253/10.36253/979-12-215-0289-3.15

References Adami, P., Singh, R., Borges Rodrigues, P., Becerik-Gerber, B., Soibelman, L., Copur-Gencturk, Y., & Lucas, G. (2023). Participants matter: Effectiveness of VR-based training on the knowledge, trust in the robot, and self-efficacy of construction workers and university students. Advanced Engineering Informatics, 55. 10.1016/j.aei.2022.101837 Azmandian, M., Hancock, M., Benko, H., Ofek, E., & Wilson, A.D. (2016). Haptic retargeting: Dynamic repurposing of passive haptics for enhanced virtual reality experiences. Conference on Human Factors in Computing Systems - Proceedings. 10.1145/2858036.2858226 Bükrü, S., Wolf, M., Böhm, B., König, M., & Teizer, J. (2020). Augmented virtuality in construction safety education and training. Proceedings of the European Group for Intelligent Computing in Engineering Conference (EG-ICE), Berlin, Germany, 115-124. Bureau of Labor Statistics (2022). National census of fatal occupational injuries in 2021. https://www.bls.gov/news.release/pdf/cfoi.pdf Chae, S., & Yoshida, T. (2010). Application of RFID technology to prevention of collision accident with heavy equipment. Automation in Construction, 19(3). 10.1016/j.autcon.2009.12.008 Fang, Y., & Teizer, J. (2014). A Multi-user Virtual 3D Training Environment to Advance Collaboration among Crane Operator and Ground Personnel in Blind Lifts. International Conference on Computing in Civil and Building Engineering Conference, 2071-2078, 10.1061/9780784413616.257 Golovina, O., Kazanci, C., Teizer, J., & König, M. (2019a). Using serious games in virtual reality for automated close call and contact collision analysis in construction safety. Proceedings of the 36th International Symposium on Automation and Robotics in Construction, ISARC 2019 10.22260/isarc2019/0129 Golovina, O., Perschewski, M., Teizer, J., & König, M. (2019b). Algorithm for quantitative analysis of close call events and personalized feedback in construction safety. Automation in Construction, 99, 206-222, 10.1016/j.autcon.2018.11.014 Golovina, O., & Teizer, J. (2022). Serious game in Virtual Reality for Safe, Active, and Personalized Learning related to Pedestrian Workers Struck By Equipment and other Construction Hazards. 22nd Conference on Construction Application of Virtual Reality (CONVR), 260–271. ISBN: 978-0-9927161-4-1. Grieves, M., & Vickers, J. (2016). Digital twin: Mitigating unpredictable, undesirable emergent behavior in complex systems. In Transdisciplinary Perspectives on Complex Systems: New Findings and Approaches. 10.1007/978-3-319-38756-7_4 Hilfert, T., Teizer, J., & König, M. (2016). First Person Virtual Reality for Evaluation and Learning of Construction Site Safety. 33rd International Symposium on Automation and Robotics in Construction, Auburn, Alabama, USA, 10.22260/ISARC2016/0025 Jacobsen, E. L., Solberg, A., Golovina, O., & Teizer, J. (2022). Active personalized construction safety training using run-time data collection in physical and virtual reality work environments. Construction Innovation, 22(3). 10.1108/CI-06-2021-0113 Jelonek, M., Fiala, E., Hermann, T., Teizer, J., Embers, S., Koenig, M., Mathis, A. (2022). Evaluating Virtual Reality Simulations for Construction Safety Training – A User Study Exploring Learning Effects, Usability and User Experience. Journal of Interactive Media, 21(2), 269-281, 10.1515/icom-2022-0006 Juang, J. R., Hung, W. H., & Kang, S. C. (2011). Using game engines for physics-based simulations - A forklift. Electronic Journal of Information Technology in Construction, 16, 3–22. Kim, A., Darakjian, N., & Finley, J.M. (2017). Walking in fully immersive virtual environments: an evaluation of potential adverse effects in older adults and individuals with Parkinson's disease. Journal of NeuroEngineering and Rehabilitation, 14(1). 10.1186/s12984-017-0225-2 Milgram, P., Takemura, H., Utsumi, A., & Kishino, F. (1994). Mixed Reality (MR) Reality-Virtuality (RV) Continuum. Systems Research, 2351(Telemanipulator and Telepresence Technologies). Narumi, T., Aoki, S., Yokoshima, T., Uyama, N., Fukushima, S., Tabuchi, G., Kanamori, H., & Wakabayashi, S. (2018). Preliminary system design for teleoperating construction in extreme environments. ISARC 2018 - 35th International Symposium on Automation and Robotics in Construction and International AEC/FM Hackathon: The Future of Building Things. 10.22260/isarc2018/0038 Park, J., Kim, K., & Cho, Y.K. (2017). Framework of Automated Construction-Safety Monitoring Using Cloud-Enabled BIM and BLE Mobile Tracking Sensors. Journal of Construction Engineering and Management, 143(2). 10.1061/(asce)co.1943-7862.0001223 Pianta, R. C., Hamre, B.K., & Allen, J.P. (2012). Teacher-student relationships and engagement: Conceptualizing, measuring, and improving the capacity of classroom interactions. In Handbook of Research on Student Engagement. 10.1007/978-1-4614-2018-7_17 Pyproj Contributors (2023). Pyproj: Python interface to PROJ. https://pyproj4.github.io/pyproj/stable/index.html Sacks, R., Brilakis, I., Pikas, E., Xie, H.S., & Girolami, M. (2020). Construction with digital twin information systems. Data-Centric Engineering, 1(6). 10.1017/dce.2020.16 Sacks, R., Perlman, A., & Barak, R. (2013). Construction safety training using immersive virtual reality. Construction Management and Economics, 31(9) 10.1080/01446193.2013.828844 Savioja, L., & Svensson, U P. (2015). Overview of geometrical room acoustic modeling techniques. The Journal of the Acoustical Society of America, 138(2). 10.1121/1.4926438 Skarbez, R., Smith, M., & Whitton, M.C. (2021). Revisiting Milgram and Kishino's Reality-Virtuality Continuum. Frontiers in Virtual Reality, 2. 10.3389/frvir.2021.647997 Speiser, K., Teizer, J. (2023a). An efficient approach for generating training environments in virtual reality using a digital twin for construction safety. Proceedings of CIBW099W123, Porto, Portugal. 481-490. ISBN: 978-972-752-309-2. 10.24840/978-972-752-309-2 Speiser, K., & Teizer, J. (2023b). An Ontology-Based Data Model to Create Virtual Training Environments for Construction Safety Using BIM and Digital Twins. 30th European Group for Intelligent Computing in Engineering Conference (EG-ICE), London, UK. Teizer, J., Cheng, T., and Fang, Y. (2013). Location Tracking and Data Visualization Technology to Advance Construction Ironworkers' Education and Training in Safety and Productivity. Automation in Construction, Elsevier, 35, 53-68, 10.1016/j.autcon.2013.03.004 Teizer, J., Johansen, K.W., Schultz, C.L., Speiser, K., Hong, K., Golovina, O. (2024). A Digital Twin Model for Advancing Construction Safety. J. Fottner et al. (Eds.): CLEaR 2023, Lecture Notes in Civil Engineering (LNCE 390), ISBN: 978-3-031-44020-5, pp. 201–212, 10.1007/978-3-031-44021-2_22 Teizer, J., Venugopal, M., & Walia, A. (2008). Ultrawideband for automated real-time three-dimensional location sensing for workforce, equipment, and material positioning and tracking. Transportation Research Record, 2081. 10.3141/2081-06 Wang, P., Wu, P., Wang, J., Chi, H.L., & Wang, X. (2018). A critical review of the use of virtual reality in construction engineering education and training. In International Journal of Environmental Research and Public Health (Vol. 15, Issue 6). 10.3390/ijerph15061204 Wielgocka, N., Hadas, T., Kaczmarek, A., & Marut, G. (2021). Feasibility of Using Low-Cost Dual-Frequency GNSS Receivers for Land Surveying. Sensors, 21(6), 1956. 10.3390/s21061956 Wolf, M., Teizer, J., & Ruse, J.H. (2019). Case Study on Mobile Virtual Reality Construction Training. 36th International Symposium on Automation and Robotics in Construction, Banff, Canada, 10.22260/ISARC2019/0165 Wolf., M., Teizer, J., Wolf, B., Bükrü, S., & Solberg, A. (2022). Investigating hazard recognition in augmented virtuality for personalized feedback in construction safety education and training. Advanced Engineering Informatics, 51, 101469, 10.1016/j.aei.2021.101469 Yanagida, Y. (2012). A survey of olfactory displays: Making and delivering scents. Proceedings of IEEE Sensors. 10.1109/ICSENS.2012.6411380 Zoleykani, M. J., Abbasianjahromi, H., Banihashemi, S., Tabadkani, S. A., & Hajirasouli, A. (2023). Extended reality (XR) technologies in the construction safety: systematic review and analysis. Construction Innovation. 10.1108/CI-05-2022-0131 Salinas, D., Muñoz-La Rivera, F., & Mora-Serrano, J. (2022). Critical Analysis of the Evaluation Methods of Extended Reality (XR) Experiences for Construction Safety. International Journal of Environmental Research and Public Health, 19(22). 10.3390/ijerph192215272