|Table of Contents|

Guidance Method for Earthquake-damaged Building Reinforcement Integrating Digital Twin and Mixed Reality(PDF)

《建筑科学与工程学报》[ISSN:1673-2049/CN:61-1442/TU]

Issue:
2022年04期
Page:
146-156
Research Field:
Publishing date:

Info

Title:
Guidance Method for Earthquake-damaged Building Reinforcement Integrating Digital Twin and Mixed Reality
Author(s):
LIU Zhan-sheng1; 2;  BAI Wen-yan1; 2;  DU Xiu-li1; 2
(1. Faculty of Architecture, Civil and Transportation Engineering, Beijing University of Technology, Beijing 100124, China; 2. Key Laboratory of Urban Security and Disaster Engineering of Ministry of Education, Beijing University of Technology, Beijing 100124, China)
Keywords:
digital twin;  mixed reality;  earthquake-damaged building;  reinforcement
PACS:
TU745
DOI:
10.19815/j.jace.2022.04015
Abstract:
The reinforcement and repair process of earthquake-damaged building is a key factor in improving its seismic capability. A thorough understanding of reinforcement methods and processes will aid in repairing earthquake-damaged buildings and improving seismic capability. Based on the development concept of digital twin and mixed reality, an intelligent guidance method suitable for earthquake-damaged building reinforcement was proposed, and a guidance reinforcement system based on digital twin and mixed reality was established. Firstly, a digital twin model was built, including four operating spaces, operations in each space and twin data. Twin databases were built to manage large amounts of data. In order to realize bidirectional mapping between physical space and virtual space, a human-computer interaction mechanism suitable for mixed reality was developed with the help of HoloLens. Finally, to evaluate the practicability and effectiveness of the proposed method, an experimental scenario was prepared for usability testing. Twenty participants were recruited using purposive sampling, and they performed the same reinforcement task under the guidance of the 2D paper version or the DTMR-DRS module. Their time to complete the task, error rate were recorded and they were asked to fill out a questionnaire.The results show that compared with traditional paper documents, the developed system DTMR-DRS transmits information more quickly. The display of text-voice-video-model also makes the construction guidance more stereoscopic and comprehensive. It has significant advantages in helping reinforcement constructors to improve work efficiency and reduce rework rates, making contribution to the research of related knowledge systems.

References:

[1] ANIL E B,AKINCI B,KURC O,et al.Building-information-modeling-based Earthquake Damage Assessment for Reinforced Concrete Walls[J].Journal of Computing in Civil Engineering,2016,30(4):04015076.
[2]XU Z,ZHANG H Z,LU X Z,et al.A Prediction Method of Building Seismic Loss Based on BIM and FEMA P-58[J].Automation in Construction,2019,102:245-257.
[3]VITIELLO U,CIOTTA V,SALZANO A,et al.BIM-based Approach for the Cost-optimization of Seismic Retrofit Strategies on Existing Buildings[J].Automation in Construction,2019,98:90-101.
[4]温留汉·黑沙,张永山,汪大洋.工程结构地震易损性与经济损失评估研究现状[J].建筑科学与工程学报,2015,32(6):17-29.
WENLIUHAN Heisha,ZHANG Yong-shan,WANG Da-yang.Review on Seismic Vulnerability and Economic Loss Assessment of Engineering Structures[J].Journal of Architecture and Civil Engineering,2015,32(6):17-29.
[5]张红歌.BIM技术在既有建筑改造中的应用探究[D].成都:西南交通大学,2016.
ZHANG Hong-ge.Application of Renovation in Existing Buildings with BIM Technology[D].Chengdu:Southwest Jiaotong University,2016.
[6]WILLIAMS R,ERKOYUNCU J A,MASOOD T,et al.Augmented Reality Assisted Calibration of Digital Twins of Mobile Robots[J].IFAC-PapersOnLine,2020,53(3):203-208.
[7]刘占省,张安山,邢泽众,等.基于数字孪生的智能建造五维模型及关键方法研究[C]//中国土木工程学会.中国土木工程学会2020年学术年会论文集.北京:中国建筑工业出版社,2020:119-131.
LIU Zhan-sheng,ZHANG An-shan,XING Ze-zhong,et al.Research on Five-dimensional Intelligent Construction Model and Key Methods Based on Digital Twin[C]//CCES.CCES 2020 Academic Annual Conference Proceedings.Beijing:China Architecture & Building Press,2020:119-131.
[8]刘占省,邢泽众,黄 春,等.装配式建筑施工过程数字孪生建模方法[J].建筑结构学报,2021,42(7):213-222.
LIU Zhan-sheng,XING Ze-zhong,HUANG Chun,et al.Digital Twin Modeling Method for Construction Process of Assembled Building[J].Journal of Building Structures,2021,42(7):213-222.
[9]SHIM C S,DANG N S,LON S,et al.Development of a Bridge Maintenance System for Prestressed Concrete Bridges Using 3D Digital Twin Model[J].Structure and Infrastructure Engineering,2019,15(10):1319-1332.
[10]NEGRI E,FUMAGALLI L,MACCHI M.A Review of the Roles of Digital Twin in CPS-based Production Systems[J].Procedia Manufacturing,2017,11:939-948.
[11]GLAESSGEN E,STARGEL D.The Digital Twin Paradigm for Future NASA and US Air Force Vehicles[C]//AIAA.Proceedings of the 53rd AIAA/ASME/ASCE/AHS/ASC Structures,Structural Dynamics and Materials Conference.Honolulu:AIAA,2012:1-14.
[12]陶 飞,刘蔚然,张 萌,等.数字孪生五维模型及十大领域应用[J].计算机集成制造系统,2019,25(1):1-18.
TAO Fei,LIU Wei-ran,ZHANG Meng,et al.Five-dimension Digital Twin Model and Its Ten Applications[J].Computer Integrated Manufacturing Systems,2019,25(1):1-18.
[13]LIU Z S,MENG X T,XING Z Z,et al.Digital Twin-based Safety Risk Coupling of Prefabricated Building Hoisting[J].Sensors,2021,21(11):3583.
[14]刘占省,刘子圣,孙佳佳,等.基于数字孪生的智能建造方法及模型试验[J].建筑结构学报,2021,42(6):26-36.
LIU Zhan-sheng,LIU Zi-sheng,SUN Jia-jia,et al.Intelligent Construction Methods and Model Experiments Based on Digital Twins[J].Journal of Building Structures,2021,42(6):26-36.
[15]LU Q C,CHEN L,LI S,et al.Semi-automatic Geometric Digital Twinning for Existing Buildings Based on Images and CAD Drawings[J].Automation in Construction,2020,115:103183.
[16]LIU Z S,SHI G L,JIANG A T,et al.Intelligent Discrimination Method Based on Digital Twins for Analyzing Sensitivity of Mechanical Parameters of Prestressed Cables[J].Applied Sciences,2021,11(4):1485.
[17]LIU Z S,SHI G L,ZHANG A S,et al.Intelligent Tensioning Method for Prestressed Cables Based on Digital Twins and Artificial Intelligence[J].Sensors,2020,20(24):7006.
[18]刘占省,张安山,王文思,等.数字孪生驱动的冬奥场馆消防安全动态疏散方法[J].同济大学学报(自然科学版),2020,48(7):962-971.
LIU Zhan-sheng,ZHANG An-shan,WANG Wen-si,et al.Dynamic Fire Evacuation Guidance Method for Winter Olympic Venues Based on Digital Twin-driven Model[J].Journal of Tongji University(Natural Science),2020,48(7):962-971.
[19]LIU Z S,BAI W Y,DU X L,et al.Digital Twin-based Safety Evaluation of Prestressed Steel Structure[J].Advances in Civil Engineering,2020,2020:8888876.
[20]ZHU Z X,LIU C,XU X.Visualisation of the Digital Twin Data in Manufacturing by Using Augmented Reality[J].Procedia CIRP,2019,81:898-903.
[21]LU Q C,XIE X,PARLIKAD A K,et al.Digital Twin-enabled Anomaly Detection for Built Asset Monitoring in Operation and Maintenance[J].Automation in Construction,2020,118:103277.
[22]MILGRAM P,TAKEMURA H,UTSUMI A,et al.Augmented Reality:A Class of Displays on the Reality-virtuality Continuum[C]//HARI D.Proceedings of SPIE:Telemanipulator and Telepresence Technologies.Boston:SPIE,1995:282-292.
[23]KE S Q,XIANG F,ZHANG Z,et al.A Enhanced Interaction Framework Based on VR,AR and MR in Digital Twin[J].Procedia CIRP,2019,83:753-758.
[24]CHALHOUB J,AYER S K.Using Mixed Reality for Electrical Construction Design Communication[J].Automation in Construction,2018,86:1-10.
[25]CHENG J C P,CHEN K Y,CHEN W W.State-of-the-art Review on Mixed Reality Applications in the AECO Industry[J].Journal of Construction Engineering and Management,2020,146(2):03119009.
[26]WANG X Y,DUNSTON P S.Comparative Effectiveness of Mixed Reality-based Virtual Environments in Collaborative Design[J].IEEE Transactions on Systems,Man,and Cybernetics,Part C(Applications and Reviews),2011,41(3):284-296.
[27]WU W,HARTLESS J,TESEI A,et al.Design Assessment in Virtual and Mixed Reality Environments:Comparison of Novices and Experts[J].Journal of Construction Engineering and Management,2019,145(9):04019049.
[28]KOPSIDA M,BRILAKIS I.Real-time Volume-to-plane Comparison for Mixed Reality-based Progress Monitoring[J].Journal of Computing in Civil Engineering,2020,34(4):04020016.
[29]KARAASLAN E,BAGCI U,CATBAS F N.Artificial Intelligence Assisted Infrastructure Assessment Using Mixed Reality Systems[J].Transportation Research Record:Journal of the Transportation Research Board,2019,2673(12):413-424.
[30]EL AMMARI K,HAMMAD A.Remote Interactive Collaboration in Facilities Management Using BIM-based Mixed Reality[J].Automation in Construction,2019,107:102940.
[31]LIU Z S,BAI W Y.Building Information Modeling Methods for Post-earthquake Retrofitting Visualization of Buildings Using Augmented Reality[J].Applied Sciences,2021,11(12):5739.
[32]王 月,张树生,白晓亮.点云和视觉特征融合的增强现实装配系统三维跟踪注册方法[J].西北工业大学学报,2019,37(1):143-151.
WANG Yue,ZHANG Shu-sheng,BAI Xiao-liang.A 3D Tracking and Registration Method Based on Point Cloud and Visual Features for Augmented Reality Aided Assembly System[J].Journal of Northwestern Polytechnical University,2019,37(1):143-151.
[33]侯守明,韩 吉,张煜东,等.基于视觉的增强现实三维注册技术综述[J].系统仿真学报,2019,31(11):2206-2215.
HOU Shou-ming,HAN Ji,ZHANG Yu-dong,et al.Survey of Vision-based Augmented Reality 3D Registration Technology[J].Journal of System Simulation,2019,31(11):2206-2215.
[34]Ergonomics of Human-system Interaction — Part 11:Usability:Definitions and Concepts:ISO 9241-11:2018[S].London:Ergonomics of Human-system Interaction,2018.

Memo

Memo:
-
Last Update: 2022-07-10