Transformer-based large vision model for universal structural damage segmentation

Chuao Zhang; Hui Li

doi:10.1016/j.autcon.2025.106256

journal article Aug 01, 2025

Transformer-based large vision model for universal structural damage segmentation

Chuao Zhang Hui Li

Automation in Construction Vol. 176 pp. 106256 · Elsevier BV

View at Publisher Save 10.1016/j.autcon.2025.106256

Topics

No keywords indexed for this article. Browse by subject →

References

86

[1]

Feng "Computer vision for SHM of civil infrastructure: from dynamic response measurement to damage detection – a review" Eng. Struct. (2018) 10.1016/j.engstruct.2017.11.018

[2]

Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring

Billie F. Spencer, Vedhus Hoskere, Yasutaka Narazaki

Engineering 2019 10.1016/j.eng.2018.11.030

[3]

A review of computer vision–based structural health monitoring at local and global levels

Chuan-Zhi Dong, F Necati Catbas

Structural Health Monitoring 2021 10.1177/1475921720935585

[4]

Review of Bridge Structural Health Monitoring Aided by Big Data and Artificial Intelligence: From Condition Assessment to Damage Detection

Limin Sun, Zhiqiang Shang, Ye Xia et al.

Journal of Structural Engineering 2020 10.1061/(asce)st.1943-541x.0002535

[5]

Deng "Review on computer vision-based crack detection and quantification methodologies for civil structures" Constr. Build. Mater. (2022) 10.1016/j.conbuildmat.2022.129238

[6]

Liu "Automated assessment of cracks on concrete surfaces using adaptive digital image processing" Smart Struct. Syst. (2014) 10.12989/sss.2014.14.4.719

[7]

Yeum "Vision-based automated crack detection for bridge inspection" Comput. Aided Civ. Infrastruct. Eng. (2015) 10.1111/mice.12141

[8]

Hsieh "Machine learning for crack detection: review and model performance comparison" J. Comput. Civ. Eng. (2020) 10.1061/(asce)cp.1943-5487.0000918

[9]

Kim "Crack and noncrack classification from concrete surface images using machine learning" Struct. Health Monit. (2019) 10.1177/1475921718768747

[10]

Machine learning paradigm for structural health monitoring

Yuequan Bao, Hui Li

Structural Health Monitoring 2021 10.1177/1475921720972416

[11]

Chen "Shifting research from defect detection to defect modeling in computer vision-based structural health monitoring" Autom. Constr. (2024) 10.1016/j.autcon.2024.105481

[12]

Guo "Surface defect detection of civil structures using images: review from data perspective" Autom. Constr. (2024) 10.1016/j.autcon.2023.105186

[13]

Agyemang "Automated vision-based structural health inspection and assessment for post-construction civil infrastructure" Autom. Constr. (2023) 10.1016/j.autcon.2023.105153

[14]

Deng "A hybrid lightweight encoder-decoder network for automatic bridge crack assessment with real-world interference" Measurement (2023) 10.1016/j.measurement.2023.112892

[15]

Gao "Vision-based fatigue crack automatic perception and geometric updating of finite element model for welded joint in steel structures" Comput. Aided Civ. Infrastruct. Eng. (2024) 10.1111/mice.13166

[16]

He "Crack segmentation on steel structures using boundary guidance model" Autom. Constr. (2024) 10.1016/j.autcon.2024.105354

[17]

Vision-guided unmanned aerial system for rapid multiple-type damage detection and localization

Shang Jiang, Yuyao Cheng, Jian Zhang

Structural Health Monitoring 2023 10.1177/14759217221084878

[18]

Hua "3D reconstruction of concrete defects using optical laser triangulation and modified spacetime analysis" Autom. Constr. (2022) 10.1016/j.autcon.2022.104469

[19]

Zhao "Concrete dam damage detection and localisation based on YOLOv5s-HSC and photogrammetric 3D reconstruction" Autom. Constr. (2022) 10.1016/j.autcon.2022.104555

[20]

Hua "Single-stripe-enhanced spacetime stereo reconstruction for concrete defect identification" Autom. Constr. (2023) 10.1016/j.autcon.2023.105136

[21]

Deng "Crack analysis of tall concrete wind towers using an ad-hoc deep multiscale encoder-decoder with depth separable convolutions under severely imbalanced data" Struct. Health Monit. (2024)

[22]

Wang "A novel transformer-based semantic segmentation framework for structural condition assessment" Struct. Health Monit. (2024) 10.1177/14759217231182303

[23]

Liu "Computer vision-based concrete crack detection using U-net fully convolutional networks" Autom. Constr. (2019) 10.1016/j.autcon.2019.04.005

[24]

Xu "Lightweight semantic segmentation of complex structural damage recognition for actual bridges" Struct. Health Monit. (2023) 10.1177/14759217221147015

[25]

Xu "Identification framework for cracks on a steel structure surface by a restricted Boltzmann machines algorithm based on consumer-grade camera images" Struct. Control. Health Monit. (2018) 10.1002/stc.2075

[26]

Xu "Surface fatigue crack identification in steel box girder of bridges by a deep fusion convolutional neural network based on consumer-grade camera images" Struct. Health Monit. (2019) 10.1177/1475921718764873

[27]

Zhao "A modified U-net for crack segmentation by self-attention-self-adaption neuron and random elastic deformation" Smart Struct. Syst. (2022)

[28]

Hoskere "Physics-based graphics models in 3D synthetic environments as autonomous vision-based inspection testbeds" Sensors (2022) 10.3390/s22020532

[29]

Zhai "Synthetic data augmentation for pixel-wise steel fatigue crack identification using fully convolutional networks" Smart Struct. Syst. (2022)

[30]

Khajwal "Post-disaster damage classification based on deep multi-view image fusion" Comput. Aided Civ. Infrastruct. Eng. (2022) 10.1111/mice.12890

[31]

Andrushia "Autonomous detection of concrete damage under fire conditions" Autom. Constr. (2022) 10.1016/j.autcon.2022.104364

[32]

Wang "Geometry-guided semantic segmentation for post-earthquake buildings using optical remote sensing images" Earthq. Eng. Struct. Dyn. (2023) 10.1002/eqe.3966

[33]

Wang "A two-stage seismic damage assessment method for small, dense, and imbalanced buildings in remote sensing images" Remote Sens. (2022) 10.3390/rs14041012

[34]

Cui "Improved swin transformer-based semantic segmentation of postearthquake dense buildings in urban areas using remote sensing images" IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. (2022) 10.1109/jstars.2022.3225150

[35]

Wang "Geometric consistency enhanced deep convolutional encoder-decoder for urban seismic damage assessment by UAV images" Eng. Struct. (2023) 10.1016/j.engstruct.2023.116132

[36]

Xu "Vision-based multi-level synthetical evaluation of seismic damage for RC structural components: a multi-task learning approach" Earthq. Eng. Eng. Vib. (2023) 10.1007/s11803-023-2153-4

[37]

Xu "Computer-vision and machine-learning-based seismic damage assessment of reinforced concrete structures" Buildings (2023) 10.3390/buildings13051258

[38]

Guo "Facade defects classification from imbalanced dataset using meta learning-based convolutional neural network" Comput. Aided Civ. Infrastruct. Eng. (2020) 10.1111/mice.12578

[39]

Ma "Structural damage identification based on unsupervised feature-extraction via variational auto-encoder" Measurement (2020) 10.1016/j.measurement.2020.107811

[40]

Wang "Unsupervised learning method for rebar signal suppression and defect signal reconstruction and detection in ground penetrating radar images" Measurement (2023) 10.1016/j.measurement.2023.112652

[41]

Jiang "A method of concrete damage detection and localization based on weakly supervised learning" Comput. Aided Civ. Infrastruct. Eng. (2024) 10.1111/mice.13124

[42]

Deng "Unsupervised PG-DDPM-augmented mixed dataset for training an accurate concrete bridge crack detection model under small samples" Measurement (2025) 10.1016/j.measurement.2024.116595

[43]

Wu "Unsupervised feature learning via non-parametric instance discrimination" (2018)

[44]

Chen "A simple framework for contrastive learning of visual representations" (2020)

[45]

He "Momentum contrast for unsupervised visual representation learning" (2020)

[46]

Grill "Bootstrap your own latent-a new approach to self-supervised learning" Adv. Neural Inf. Proces. Syst. (2020)

[47]

Reed "Self-supervised pretraining improves self-supervised pretraining" (2022)

[48]

Li "Targeted supervised contrastive learning for long-tailed recognition" (2022)

[49]

Xu "A weakly supervised surface defect detection based on convolutional neural network" IEEE Access (2020) 10.1109/access.2020.2977821

[50]

Zhu "Weakly supervised network based intelligent identification of cracks in asphalt concrete bridge deck" Alex. Eng. J. (2020) 10.1016/j.aej.2020.02.027

Showing 50 of 86 references

Metrics

22

Citations

86

References

Details

Published: Aug 01, 2025
Vol/Issue: 176
Pages: 106256
License: View

Authors

Department of Biochemistry and Molecular Biology, University of Chicago, Chicago, Illinois 60637, United States

Funding

National Natural Science Foundation of China Award: 52192661

Fundamental Research Funds for the Central Universities Award: HIT.NSRIF202334

National Key Research and Development Program of China Award: 2023YFC3805800

Ministry of Science and Technology of the People's Republic of China

Cite This Article

Chuao Zhang, Hui Li (2025). Transformer-based large vision model for universal structural damage segmentation. Automation in Construction, 176, 106256. https://doi.org/10.1016/j.autcon.2025.106256

Transformer-based large vision model for universal structural damage segmentation

You May Also Like