journal article Open Access Jul 22, 2024

Autonomous Crack Detection for Mountainous Roads Using UAV Inspection System

Sensors Vol. 24 No. 14 pp. 4751 · MDPI AG
View at Publisher Save 10.3390/s24144751
Abstract
Road cracks significantly affect the serviceability and safety of roadways, especially in mountainous terrain. Traditional inspection methods, such as manual detection, are excessively time-consuming, labor-intensive, and inefficient. Additionally, multi-function detection vehicles equipped with diverse sensors are costly and unsuitable for mountainous roads, primarily because of the challenging terrain conditions characterized by frequent bends in the road. To address these challenges, this study proposes a customized Unmanned Aerial Vehicle (UAV) inspection system designed for automatic crack detection. This system focuses on enhancing autonomous capabilities in mountainous terrains by incorporating embedded algorithms for route planning, autonomous navigation, and automatic crack detection. The slide window method (SWM) is proposed to enhance the autonomous navigation of UAV flights by generating path planning on mountainous roads. This method compensates for GPS/IMU positioning errors, particularly in GPS-denied or GPS-drift scenarios. Moreover, the improved MRC-YOLOv8 algorithm is presented to conduct autonomous crack detection from UAV imagery in an on/offboard module. To validate the performance of our UAV inspection system, we conducted multiple experiments to evaluate its accuracy, robustness, and efficiency. The results of the experiments on automatic navigation demonstrate that our fusion method, in conjunction with SWM, effectively enables real-time route planning in GPS-denied mountainous terrains. The proposed system displays an average localization drift of 2.75% and a per-point local scanning error of 0.33 m over a distance of 1.5 km. Moreover, the experimental results on the road crack detection reveal that the MRC-YOLOv8 algorithm achieves an F1-Score of 87.4% and a mAP of 92.3%, thus surpassing other state-of-the-art models like YOLOv5s, YOLOv8n, and YOLOv9 by 1.2%, 1.3%, and 3.0% in terms of mAP, respectively. Furthermore, the parameters of the MRC-YOLOv8 algorithm indicate a volume reduction of 0.19(×106) compared to the original YOLOv8 model, thus enhancing its lightweight nature. The UAV inspection system proposed in this study serves as a valuable tool and technological guidance for the routine inspection of mountainous roads.
Topics

No keywords indexed for this article. Browse by subject →

References
38
[1]
Jiang, Y.T., Yan, H.T., Zhang, Y.R., Wu, K.Q., Liu, R.Y., and Lin, C.Y. (2023). RDD-YOLOv5: Road Defect Detection Algorithm with Self-Attention Based on Unmanned Aerial Vehicle Inspection. Sensors, 23. 10.3390/s23198241
[2]
Guo, S., Xu, Z., Li, X., and Zhu, P. (2022). Detection and Characterization of Cracks in Highway Pavement with the Amplitude Variation of GPR Diffracted Waves: Insights from Forward Modeling and Field Data. Remote Sens., 14. 10.3390/rs14040976
[3]
Zhao, Y., Zhou, L., Wang, X., Wang, F., and Shi, G. (2023). Highway Crack Detection and Classification Using UAV Remote Sensing Images Based on CrackNet and CrackClassification. Appl. Sci., 13. 10.3390/app13127269
[4]
Lai, L. (2024, April 20). Beautiful Travel. Available online: http://mms2.baidu.com/it/u=767749105,3305563617&fm=253&app=138&f=JPEG?w=607&h=403.
[5]
Zhu "Pavement distress detection using convolutional neural networks with images captured via UAV" Autom. Constr. (2022) 10.1016/j.autcon.2021.103991
[6]
Yu "UAV-based pipeline inspection system with Swin Transformer for the EAST" Fusion Eng. Des. (2022) 10.1016/j.fusengdes.2022.113277
[7]
Ma, Y., Li, Q., Chu, L., Zhou, Y., and Xu, C. (2021). Real-Time Detection and Spatial Localization of Insulators for UAV Inspection Based on Binocular Stereo Vision. Remote Sens., 13. 10.3390/rs13020230
[8]
Liu, K. (2023). Learning-based defect recognitions for autonomous UAV inspections. arXiv.
[9]
Chen, X., Zhu, X., and Liu, C. (2023). Real-Time 3D Reconstruction of UAV Acquisition System for the Urban Pipe Based on RTAB-Map. Appl. Sci., 13. 10.3390/app132413182
[10]
Metni "A UAV for bridge inspection: Visual servoing control law with orientation limits" Autom. Constr. (2007) 10.1016/j.autcon.2006.12.010
[11]
Zhou "UAV vision detection method for crane surface cracks based on Faster R-CNN and image segmentation" J. Civ. Struct. Health Monit. (2022) 10.1007/s13349-022-00577-1
[12]
Xiang, X., Hu, H., Ding, Y., Zheng, Y., and Wu, S. (2023). GC-YOLOv5s: A Lightweight Detector for UAV Road Crack Detection. Appl. Sci., 13. 10.3390/app131911030
[13]
Wang, X., Gao, H., Jia, Z., and Li, Z. (2023). BL-YOLOv8: An Improved Road Defect Detection Model Based on YOLOv8. Sensors, 23. 10.3390/s23208361
[14]
Soumen "Transfer Learning Based Deep Convolutional Neural Network Model for Pavement Crack Detection from Images" Int. J. Nonlinear Anal. Appl. (2022)
[15]
ImageNet classification with deep convolutional neural networks

Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton

Communications of the ACM 2017 10.1145/3065386
[16]
Xu, X., Zhao, M., Shi, P., Ren, R., He, X., Wei, X., and Yang, H. (2022). Crack detection and comparison study based on faster R-CNN and mask R-CNN. Sensors, 22. 10.3390/s22031215
[17]
Meftah, I., Hu, J., Asham, M.A., Meftah, A., Zhen, L., and Wu, R. (2024). Deep Learning for Autonomous Vehicle Road Crack Visual Detection. Sensors, 24. 10.3390/s24051647
[18]
Su "Research on Road Crack Detection Model Based on YOLOv3 Deep Learning Algorithm" China J. Highw. Transp. (2023)
[19]
Zhou "Detection and Recognition of YOLOv5 Pavement Cracks Based on Attention Mechanism" J. East China Jiaotong Univ. (2023)
[20]
Ultralytics (2023, January 26). YOLOv8. Available online: https://github.com/ultralytics/ultralytics.
[21]
Wang, G., Chen, Y., An, P., Hong, H., Hu, J., and Huang, T. (2023). UAV-YOLOv8: A Small-Object-Detection Model Based on Improved YOLOv8 for UAV Aerial Photography Scenarios. Sensors, 23. 10.3390/s23167190
[22]
Chen, X., Liu, C., Chen, L., Zhu, X., Zhang, Y., and Wang, C. (2024). A Pavement Crack Detection and Evaluation Framework for a UAV Inspection System Based on Deep Learning. Appl. Sci., 14. 10.20944/preprints202401.1925.v1
[23]
Zhang "Road damage detection using UAV images based on multi-level attention mechanism" Autom. Constr. (2022) 10.1016/j.autcon.2022.104613
[24]
Omoebamije "An improved deep learning convolutional neural network for crack detection based on UAV images" Innov. Infrastruct. Solut. (2023) 10.1007/s41062-023-01209-3
[25]
Samadzadegan "Automatic Road Crack Recognition Based on Deep Learning Networks from UAV Imagery" ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci. (2022)
[26]
Suwandi, B., Kitasuka, T., and Aritsugi, M. (2017, January 5–8). Low-cost IMU and GPS fusion strategy for apron vehicle positioning. Proceedings of the IEEE Region 10th Conference (TENCON), Penang, Malaysia. 10.1109/tencon.2017.8227906
[27]
Li "Sampling-Based Real-Time Motion Planning under State Uncertainty for Autonomous Micro-Aerial Vehicles in GPS-Denied Environments" Sensors (2014) 10.3390/s141121791
[28]
Lee, Y., Yoon, J., Yang, H., Kim, C., and Lee, D. (2016, January 5–8). Camera-GPS-IMU sensor fusion for autonomous flying. Proceedings of the 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN), Vienna, Austria.
[29]
Rizk, M., Mroue, A., Farran, M., and Charara, J. (September, January 31). Real-Time SLAM Based on Image Stitching for Autonomous Navigation of UAVs in GNSS-Denied Regions. Proceedings of the 2nd IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS), Genova, Italy.
[30]
Çağlar, F.O., and Özgenel, R. (2019). Concrete Crack Images for Classification. Mendeley Data, V2.
[31]
Focal and efficient IOU loss for accurate bounding box regression

Yi-Fan Zhang, Weiqiang Ren, Zhang Zhang et al.

Neurocomputing 2022 10.1016/j.neucom.2022.07.042
[32]
Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression

Zhaohui Zheng, Ping Wang, Wei Liu et al.

Proceedings of the AAAI Conference on Artificial I... 10.1609/aaai.v34i07.6999
[33]
Wei, H., Liu, X., Xu, S.-t., Dai, Z., Dai, Y., and Xu, X. (2022). DWRSeg: Rethinking Efficient Acquisition of Multi-scale Contextual Information for Real-time Semantic Segmentation. arXiv.
[34]
Wong, K.Y. (2023, January 26). YOLOv7. Available online: https://github.com/WongKinYiu/yolov7.
[35]
Xing, J., Liu, Y., and Zhang, G. (2024). Concrete Highway Crack Detection Based on Visible Light and Infrared Silicate Spectrum Image Fusion. Sensors, 24. 10.3390/s24092759
[36]
Georgia Tech Research Institute (2024, January 26). Automated Pavement Crack Detection and Sealing Prototype System. Available online: https://www.newswise.com/articles/automated-pavement-crack-detection-and-sealing-prototype-system-developed-by-gtri.
[37]
Yang "Real time approach for underground objects detection from vehicle-borne ground penetrating radar" Acta Geod. Cartogr. Sin. (2020)
[38]
Wu "Road pothole extraction and safety evaluation by integration of point cloud and images derived from mobile mapping sensor" Adv. Eng. Inform. (2019) 10.1016/j.aei.2019.100936
Metrics
21
Citations
38
References
Details
Published
Jul 22, 2024
Vol/Issue
24(14)
Pages
4751
License
View
Funding
the Ministry of Education of Humanities and Social Science Project Award: 19YJC790014
Chinese national college students innovation and entrepreneurship training program Award: 19YJC790014
Hunan province college students innovation and entrepreneurship training program Award: 19YJC790014
Cite This Article
Xinyi Chen, Chenxi Wang, Chang Liu, et al. (2024). Autonomous Crack Detection for Mountainous Roads Using UAV Inspection System. Sensors, 24(14), 4751. https://doi.org/10.3390/s24144751
Related

You May Also Like

SECOND: Sparsely Embedded Convolutional Detection

Yan Yan, Yuyin Mao · 2018

2,824 citations

Metal Oxide Gas Sensors: Sensitivity and Influencing Factors

Chengxiang Wang, Longwei Yin · 2010

2,595 citations

Machine Learning in Agriculture: A Review

Konstantinos Liakos, Patrizia Busato · 2018

2,472 citations

Wearable Electronics and Smart Textiles: A Critical Review

Matteo Stoppa, Alessandro Chiolerio · 2014

1,823 citations