Multi-Robot Federated Edge Learning Framework for Efficient Coordination and Information Management in Smart Construction Xinqi Liu The University of Hong Kong, Hong Kong Jihua Wang The University of Hong Kong, Hong Kong Ruopan Huang The University of Hong Kong, Hong Kong Wei Pan The University of Hong Kong, Hong Kong This is a section of CONVR 2023 - Proceedings of the 23rd International Conference on Construction Applications of Virtual Reality (DOI: 10.36253/979-12-215-0289-3) by Pietro Capone, Vito Getuli, Farzad Pour Rahimian, Nashwan Dawood, Alessandro Bruttini, Tommaso Sorbi Firenze University Press Florence 2023 https://doi.org/10.36253/10.36253/979-12-215-0289-3.54

Available for academic research purposes

Open Access

Copyright Author(s)

Content licence CC BY-NC 4.0

Metadata licence CC0 1.0

This is original content, published for academic research purposes

 Digital edition XML powered by Booksflow

Smart construction involves a growing array of devices that generate extensive data, capable of enhancing construction efficiency and productivity. Nonetheless, the handling of this diverse and abundant information, along with the geographical spread of construction sites, poses challenges to effective communication and information processing within the management system. Multi-robot systems, as a new type of Internet of Things device, have the potential ability to coordinate workers to complete their work while serving as an edge node for information storage and processing. This paper presents a multi-robot federated edge learning framework that facilitates construction information management and communication. The work demonstrates the role of distributed databases in processing information during project execution, in contrast to centralized information systems. To address the intricacies of construction sites and the wide array of equipment involved, unmanned aerial vehicles and quadruped robots are employed as edge nodes. The formation of a federated edge learning framework ensures the real-time processing of massive data and data privacy issues. The Federated Multi-Robot (FedMR) framework is a global sharing model focused on preserving differential privacy protection. This framework is distributed to multiple edge robots in each round, enabling local real-time processing of robot tasks. The system can accomplish target detection and tracking of workers based on computer vision. Additionally, we collect MiC energy consumption data during the construction process and predict carbon emissions. Based on the implementation and testing of the system, it has been shown to provide structured and reliable information, fast local transmission, and the ability to process information in real-time. The system's ability to coordinate workers and process information makes it a valuable tool in smart construction

 Construction management federated learning multi-robots Information management differential privacy Modular Integrated Construction(MiC)

It is available online at https://doi.org/10.36253/10.36253/979-12-215-0289-3.54

References Akinosho, T. D., Oyedele, L. O., Bilal, M., Ajayi, A. O., Delgado, M. D., Akinade, O. O., & Ahmed, A. A. (2020). Deep learning in the construction industry: A review of present status and future innovations. Journal of Building Engineering, 32(101827). 10.1016/j.jobe.2020.101827 Arayici, Y., Egbu, C., & Coates, P. (2012). Building Information Modelling (Bim) Implementation and Remote Construction Projects: Issues, Challenges, and Critiques. Electronic Journal of Information Technology in Construction, 17, 75–92. Bisht, N., & Singh, S. (2015). Analytical study of different network topologies. International Research Journal of Engineering and Technology (IRJET), 2(01), 88–90. Carrillo, P., Ruikar, K., & Fuller, P. (2013). When Will We Learn? Improving Lessons Learned Practice in Construction. International Journal of Project Management, 31(4), 567–578. 10.1016/j.ijproman.2012.10.005 Doloi, H. (2013). Cost Overruns, and Failure in Project Management: Understanding the Roles of Key Stakeholders in Construction Projects. Journal of Construction Engineering and Management, 139, 267–279. 10.1061/(ASCE)CO.1943-7862.0000621 Fang, W., Ding, L., Zhong, B., & Love, P. E. D. (2018). Automated detection of workers and heavy equipment on construction sites: A convolutional neural network approach. Advanced Engineering Informatics, 37, 139–149. 10.1016/j.aei.2018.05.003 Google. (2019). Tensorflow federated. https://www.tensorflow.org/federated Honegger, D., Oleynikova, H., & Pollefeys, M. (2014). Real-time and low latency embedded computer vision hardware based on a combination of FPGA and mobile CPU. In 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, 4930–4935. 10.1109/IROS.2014.6943263 Jiang, Y., Liu, X., Kang, K., Wang, Z., Zhong, R. Y., & Huang, G. Q. (2021). Blockchain-enabled cyber-physical smart modular integrated construction. Computers in Industry, 133, 103533. 10.1016/j.compind.2021.103553 Kim, C., Son, H., & Kim, C. (2013). Automated Construction Progress Measurement Using a 4D Building Information Model and 3D Data. Automation in Construction, 31, 75–82. 10.1016/j.autcon.2012.11.041 Li, L., Fan, Y., Tse, M., & Lin, K. (2020). A review of applications in federated learning. Computers & Industrial Engineering, 149, 106854. 10.1016/j.cie.2020.106854 Luo, L., Shen, Q. G., Xu, G., Liu, Y., & Wang, Y. (2019). Stakeholder-associated supply chain risks and their interactions in a prefabricated building project in Hong Kong. Journal of Management in Engineering, 35(2), 05018015. 10.1061/(ASCE)ME.1943-5479.0000675 Niu, S., Pan, W., & Zhao, Y. (2015). A BIM-GIS integrated web-based visualization system for low energy building design. Procedia Engineering, 121, 2184–2192. 10.1016/j.proeng.2015.09.091 Niu, S., Pan, W., & Zhao, Y. (2016). A virtual reality integrated design approach to improving occupancy information integrity for closing the building energy performance gap. Sustainable Cities and Society, 27, 275–286. 10.1016/j.scs.2016.03.010 Ojo, E., Charles, M., & Esther, T. A. (2014). Barriers in implementing green supply chain management in construction industry. Proceedings of the 2014 International Conference on Industrial Engineering and Operations Management, Bali, Indonesia. 10.18485/epmj.2020.10.2.5 Pan, M., & Pan, W. (2019). Determinants of adoption of robotics in precast concrete production for buildings. Journal of Management in Engineering, 35(5), 05019007. 10.1061/(ASCE)ME.1943-5479.0000706 Pan, M., Yang, Y., Zheng, Z. J., & Pan, W. (2022). Artificial Intelligence and Robotics for Prefabricated and Modular Construction: A Systematic Literature Review. Journal of Construction Engineering and Management, 148(9). 10.1061/(ASCE)CO.1943-7862.0002324 Ramaswamy, S., Mathews, R., Rao, K., & Beaufays, F. (2019). Federated learning for emoji prediction in a mobile keyboard. http://arxiv.org/abs/1906.04329 Webank (2019a). (n.d.). Federated AI Technology Enabler. (FATE). https://github.com/weban kfintech/fate Accessed 2019 Wuni, I. Y., Shen, G. Q. P., & Mahmud, A. T. (2022). Critical risk factors in the application of modular integrated construction: A systematic review. International Journal of Construction Management, 22, 1–15. 10.1080/15623599.2019.1613212 Xu, S., Wang, J., Shou, W., Ngo, T., Sadick, A. M., & Wang, X. (2021). Computer vision techniques in construction: A critical review. Archives of Computational Methods in Engineering, 28(5), 3383–3397. 10.22260/ISARC2019/0090 Yan, N. (2014). Quantitative effects of drivers and barriers on networking strategies in public construction projects. International Journal of Project Management, 32(2), 286–297. https://doi.org/10.1016/j.ijproman.2013.04.003 Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019). Federated machine learning: Concept and applications. ACM Transactions on Intelligent Systems and Technology, 10(2), 1–19. 10.1145/3298981