|本期目录/Table of Contents|

[1]杨铄,冷予冰,许清风.基于深度学习和图像识别的RC框架节点表面损伤检测评估研究[J].建筑科学与工程学报,2026,(01):41-55.[doi:10.19815/j.jace.2024.06089]
 YANG Shuo,LENG Yubing,XU Qingfeng.Study on surface damage detection of RC frame joints based on deep-learning and image recognition[J].Journal of Architecture and Civil Engineering,2026,(01):41-55.[doi:10.19815/j.jace.2024.06089]
点击复制

基于深度学习和图像识别的RC框架节点表面损伤检测评估研究(PDF)
分享到:

《建筑科学与工程学报》[ISSN:1673-2049/CN:61-1442/TU]

卷:
期数:
2026年01期
页码:
41-55
栏目:
智能检测与建造技术专栏
出版日期:
2026-01-20

文章信息/Info

Title:
Study on surface damage detection of RC frame joints based on deep-learning and image recognition
文章编号:
1673-2049(2026)01-0041-15
作者:
杨铄1,2冷予冰3许清风3
1. 天津城建大学 土木工程学院,天津 300384; 2. 天津城建大学 天津市土木建筑结构防护与加固重点实验室,天津 300384; 3. 上海市建筑科学研究院有限公司 上海市工程结构安全重点实验室,上海 200032
Author(s):
YANG Shuo1,2, LENG Yubing3, XU Qingfeng3
1. School of Civil Engineering, Tianjin Chengjian University, Tianjin 300384, China; 2. Tianjin Key Laboratory of? Civil Structure Protection and Reinforcement, Tianjin Chengjian University, Tianjin 300384, China; 3. Shanghai Key Laboratory of Engineering Structure Safety, Shanghai Research Institute of Building Sci. Co., Ltd,? Shanghai 200032, China
关键词:
钢筋混凝土框架节点深度学习掩码区域卷积神经网络表面损伤检测
Keywords:
reinforced concrete frame joint deep learning Mask R-CNN surface damage detection
分类号:
TU375
DOI:
10.19815/j.jace.2024.06089
文献标志码:
A
摘要:
为提高钢筋混凝土(RC)结构表面损伤检测效率,实现RC构件表面损伤定位、精细化量测和评估的一体化,针对RC框架结构表面损伤检测场景,提出了基于深度学习和图像识别的损伤检测评估方法。基于掩码区域卷积神经网络(Mask RCNN)模型和图像处理建立RC框架构件表面损伤检测模型;采用以往RC构件试验中的损伤和破坏照片,经裁剪和数据增强后建立包含裂缝、剥落、压碎、露筋、钢筋屈曲和钢筋断裂6种类型损伤的RC构件表面损伤数据集用以训练模型;基于三维重建所生成的构件正立面全景图以及损伤检测模型,编写可同步进行RC构件表面损伤定位和损伤几何参数分析的检测程序,并集成RC构件损伤等级划分和破坏形态判断标准,用以量化评估和判断RC构件损伤程度和破坏形态;设计制作了两个足尺RC梁柱节点试件并进行了试验,使用智能手机和小型无人机对破坏的节点试件梁进行拍照,检测构件表面损伤,以验证上述损伤检测方法的有效性。结果表明:基于智能手机拍照的检测结果好于基于无人机数字变焦拍照的检测结果;因训练样本较少,钢筋屈曲和钢筋断裂的检测精度较差;当镜头距构件表面200 mm左右时,裂缝宽度测量精度可达0.1 mm,若裂缝实测宽度大于0.5 mm,基于上述方法的裂缝宽度检测精度较高;使用检测程序分析得到的构件损伤等级(程度)和破坏形态与观测结果一致;基于深度学习和图像识别的损伤检测方法可为受损或震后RC框架构件表面损伤定量化快速检测和评估提供支撑。
Abstract:
In order to improve the efficiency of surface damage detection of reinforced concrete (RC) structures and to realize the integration of RC component surface damage localization, fine measurement and evaluation, a damage detection and assessment method based on the deep learning and image recognition was proposed for the scenario of detection of surface damage for RC frame structures. The surface damage detection model of RC frame members was established based on the mask region convolutional neural network (Mask R-CNN) model and image processing. Based on the images of damage and destruction in previous RC component tests, the surface damage dataset of RC components including six types of damage, i.e. crack, spalling, crushing, rebar exposure, rebar buckling and rebar fracture, was established after cropping and data augmentation to train the model. Based on the 3D reconstruction and the damage detection model, an inspection program, which could simultaneously locate the surface damage of RC components and analyze the damage geometric parameters, was made and integrated the criteria for classifying the damage level and judging the damage pattern of RC components to quantitatively assess the damage degrees and judge the damage patterns for RC components. Two fullscale RC beamcolumn joint specimens were designed, fabricated, and used to conduct an experimental test. The damaged joint specimens were photographed with a smart phone and a small unmanned aerial vehicle (UAV) to detect the surface damage of the beams for validation of the above damage detection method. The results show that the detection results based on the smart phone are better than those based on UAV digital zoom shooting. The accuracy of the rebar buckling and fracture is poor due to the fewer training samples. When the lens is about 200 mm from the surface of the members, the measurement accuracy of crack width can reach 0.1 mm. If the measured crack width is greater than 0.5 mm, the crack width detection accuracy of the above method is higher. The damage grades (degrees) and failure patterns of components analyzed by the detection program are consistent with the observation. The damage detection method based on the deep learning and image recognition can support quantitative surface damage rapid detection and assessment for damaged or postearthquake RC frame components.

参考文献/References:

1 ]陈肇元 , 徐有邻 , 钱稼茹 . 土建结构工程的安全性与耐久性[ J . 建筑技术 ,2002,33(4):248 - 253.

CHEN Zhaoyuan, XU Youlin, QIAN Jiaru. Safety and durability of structural works in civil engineering J . Architecture Technology, 2002, 33(4): 248 - 253.

2 ]霍林生 , 李宏男 , 肖诗云 , . 汶川地震钢筋混凝土框架结构震害调查与启示[ J . 大连理工大学学报 ,2009,49(5):718 - 723.

HUO Linsheng, LI Hongnan, XIAO Shiyun, et al. Earthquake damage investigation and analysis of reinforced concrete frame structures in Wenchuan earthquake J . Journal of Dalian University of Technology, 2009, 49(5): 718 - 723.

3 ]建筑震后应急评估和修复技术规程 :JGJ/T 415 2017 S . 北京 : 中国建筑工业出版社 ,2017.

Technical specification for post - earthquake urgent assessment and repair of buildings: JGJ/T 415 2017 S . Beijing: China Architecture & Building Press, 2017.

4 GRAYBEAL B A, PHARES B M, ROLANDER D D, et al. Visual inspection of highway bridges J . Journal of Nondestructive Evaluation, 2002, 21(3): 67 - 83.

5 ]韩晓健 , 赵志成 . 基于计算机视觉技术的结构表面裂缝检测方法研究[ J . 建筑结构学报 ,2018,39( 1):418 - 427.

HAN Xiaojian, ZHAO Zhicheng. Research on detection method of structural surface cracks based on computer vision technology J . Journal of Building Structures, 2018, 39(S1): 418 - 427.

6 ZAKERI H, NEJAD F M, FAHIMIFAR A. Image based techniques for crack detection, classification and quantification in asphalt pavement: a review J . Archives of Computational Methods in Engineering, 2017, 24(4): 935 - 977.

7 HAN X J, ZHAO Z C, CHEN L K, et al. Structural damage - causing concrete cracking detection based on a deep - learning method J . Construction and Building Materials, 2022, 337: 127562.

8 ]周 , . 基于计算机视觉的混凝土裂缝识别[ J . 同济大学学报 ( 自然科学版 ),2019,47(9):1277 - 1285.

ZHOU Ying, LIU Tong. Computer vision - based crack detection and measurement on concrete structure J . Journal of Tongji University (Natural Science), 2019, 47(9): 1277 - 1285.

9 ]杨国俊 , 齐亚辉 , 石秀名 . 基于数字图像技术的桥梁裂缝检测综述[ J . 吉林大学学报 ( 工学版 ),2024, 54(2) :313 - 332.

YANG Guojun, QI Yahui, SHI Xiuming. Review of bridge crack detection based on digital image technology J . Journal of Jilin University (Engineering and Technology Edition), 2024, 54(2): 313 - 332.

10 ALI L, ALNAJJAR F, KHAN W, et al. Bibliometric analysis and review of deep learning - based crack detection literature published between 2010 and 2022 J . Buildings, 2022, 12(4): 432.

11 ]杨 , 许清风 , 王卓琳 . 基于卷积神经网络的结构损伤识别研究进展[ J . 建筑科学与工程学报 ,2022, 39(4) :38 - 57.

YANG Shuo, XU Qingfeng, WANG Zhuolin. Research progress on structural damage detection based on convolutional neural networks J . Journal of Architecture and Civil Engineering, 2022, 39(4): 38 - 57.

12 DOGAN G, HAKAN ARSLAN M, ILKI A. Detection of damages caused by earthquake and reinforcement corrosion in RC buildings with deep transfer learning J . Engineering Structures, 2023, 279: 115629.

13 ]刘宇飞 , 樊健生 , 聂建国 , . 结构表面裂缝数字图像法识别研究综述与前景展望[ J . 土木工程学报 ,2021,54(6):79 - 98.

LIU Yufei, FAN Jiansheng, NIE Jianguo, et al. Review and prospect of digital - image - based crack detection of structure surface J . China Civil Engineering Journal, 2021, 54(6): 79 - 98.

14 BAI Z L, LIU T J, ZOU D J, et al. Image - based reinforced concrete component mechanical damage recognition and structural safety rapid assessment using deep learning with frequency information J . Automation in Construction, 2023, 150: 104839.

15 CHEN L K, CHEN W X, WANG L, et al. Convolutional neural networks (CNNs) - based multi - category damage detection and recognition of high - speed rail (HSR) reinforced concrete (RC) bridges using test images J . Engineering Structures, 2023, 276: 115306.

16 MENG S Q, GAO Z Y, ZHOU Y, et al. Real - time automatic crack detection method based on drone J . Computer - aided Civil and Infrastructure Engineering, 2023, 38(7): 849 - 872.

17 LIU Y F, NIE X, FAN J S, et al. Image - based crack assessment of bridge piers using unmanned aerial vehicles and three - dimensional scene reconstruction J . Computer - aided Civil and Infrastructure Engineering, 2020, 35(5): 511 - 529.

18 ZHAO S Z, KANG F, LI J J. Concrete dam damage detection and localisation based on YOLOv5s - HSC and photogrammetric 3D reconstruction J . Automation in Construction, 2022, 143: 104555.

19 ]国务院,中央军委 . 无人驾驶航空器飞行管理暂行条例[ EB/OL . 2023 - 06 - 28 )[ 2024 - 04 - 15 .https://www.gov.cn/zhengce/zhengceku/202306/content_6888800.htm.

State Council, Central Military Commission. Regulations on the administration of unmanned aerial vehicle EB/OL . 2023 - 06 - 28 )[ 2024 - 04 - 15 . https://www.gov.cn/zhengce/zhengceku/202306/content_6888800.htm.

20 ]杨 , , 李天昊 . 基于无人机与计算机视觉的中国古建筑木结构裂缝监测系统设计[ J . 工程力学 ,2021,38(3):27 - 39.

YANG Na, ZHANG Chong, LI Tianhao. Design of crack monitoring system for Chinese ancient wooden buildings based on UAV and CV J . Engineering Mechanics, 2021, 38(3): 27 - 39.

21 ]工程结构数字图像法检测技术规程 :T/CECS 1114 2022 S . 北京 : 中国建筑工业出版社 ,2022.

Technical specification for digital image inspection of engineering structures: T/CECS 1114 2022 S . Beijing: China Architecture & Building Press, 2022.

22 CHOW J K, LIU K F, TAN P S, et al. Automated defect inspection of concrete structures J . Automation in Construction, 2021, 132: 103959.

23 HARTLEY R, ZISSERMAN A. Multiple view geometry in computer vision M . Cambridge: Cambridge University Press, 2004.

24 KIM B, CHO S. Image - based concrete crack assessment using mask and region - based convolutional neural network J . Structural Control and Health Monitoring, 2019, 26(8): e2381.

25 ]宋成浩 , 陈书成 , 胡晓斌 , . 基于计算机视觉的往复荷载作用下钢筋混凝土柱裂缝监测[ J . 工业建筑 ,2022,52(10):53 - 60.

SONG Chenghao, CHEN Shucheng, HU Xiaobin, et al . Crack monitoring of RC columns under cyclic loading based on computer vision J . Industrial Construction, 2022, 52(10): 53 - 60.

26 REN S Q, HE K M, GIRSHICK R, et al. Faster R - CNN: towards real - time object detection with region proposal networks J . IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137 - 1149.

27 HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition C //IEEE. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas: IEEE, 2016: 770 - 778.

28 LIN T Y, DOLLAR P, GIRSHICK R, et al. Feature pyramid networks for object detection C // IEEE. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu: IEEE, 2017:936 - 944.

29 KALFARISI R, WU Z Y, SOH K. Crack detection and segmentation using deep learning with 3D reality mesh model for quantitative assessment and integrated visualization J . Journal of Computing in Civil Engineering, 2020, 34(3): 04020010.

30 ]章毓晋 . 计算机视觉教程[ M .2 . 北京 : 人民邮电出版社 ,2017.

ZHANG Yujin. A course of computer vision M . 2nd ed. Beijing: Posts & Telecom Press, 2017.

31 OTSU N. A threshold selection method from gray - level histograms J . IEEE Transactions on Systems, Man, and Cybernetics, 1979, 9(1): 62 - 66.

32 ]PAYAB M, ABBASINA R, KHANZADI M. A brief review and a new graph - based image analysis for concrete crack quantification J . Archives of Computational Methods in Engineering, 2019, 26(2): 347 - 365.

33 ]建筑抗震试验规程 :JGJ/T 101 2015 S . 北京 : 中国建筑工业出版社 ,2015.

Specification for seismic test of buildings: JGJ/T 101 2015 S . Beijing: China Architecture & Building Press, 2015.

34 ]建 ( ) 筑物地震破坏等级划分 :GB/T 24335 2009 S . 北京 : 中国标准出版社 ,2009.

Classification of earthquake damage to buildings and special structures: GB/T 24335 2009 S . Beijing: Standards Press of China, 2009.

35 ] OHKUBO M. Current Japanese system on seismic capacity and retrofit techniques for existing reinforced concrete buildings and post - earthquake damage inspection and restoration techniques R . San Diego: Department of Applied Mechanics and Engineering Sciences, University of California, 1991.

36 SINHA R, GOYAL A. A national policy for seismic vulnerability assessment of buildings and procedure for rapid visual screening of buildings for potential seismic vulnerability R . Hindistan: Ministry of Home Affairs, Government of India, 2004.

37 ]房屋完损等级评定标准(试行) : 城住字( 1984 )第 678 号[ S . 北京 : 城乡建设环境保护部 , 1984.

Standard for assessing the level of housing deterioration(trial): Cheng Zhuzi (1984) No.678 S . Beijing: Ministry of Urban and Rural Construction and Environmental Protection, 1984.

38 ZOU D J, ZHANG M, BAI Z L, et al. Multicategory damage detection and safety assessment of post - earthquake reinforced concrete structures using deep learning J . Computer - aided Civil and Infrastructure Engineering, 2022, 37(9): 1188 - 1204.

相似文献/References:

[1]马宏伟,林逸洲,聂振华. 利用少量传感器信息与人工智能的桥梁结构安全监测新方法[J].建筑科学与工程学报,2018,35(05):9.
 MA Hong-wei,LIN Yi-zhou,NIE Zhen-hua.New Methods of Structural Health Monitoring Based on Small Amount of Sensor Information and Artificial Intelligence[J].Journal of Architecture and Civil Engineering,2018,35(01):9.

备注/Memo

备注/Memo:
上海市青年科技英才扬帆计划项目(22YF1437800)
更新日期/Last Update: 2026-01-20