journal article Open Access Aug 07, 2024

ALKU-Net: Adaptive Large Kernel Attention Convolution Network for Lung Nodule Segmentation

Electronics Vol. 13 No. 16 pp. 3121 · MDPI AG
View at Publisher Save 10.3390/electronics13163121
Abstract
The accurate segmentation of lung nodules in computed tomography (CT) images is crucial for the early screening and diagnosis of lung cancer. However, the heterogeneity of lung nodules and their similarity to other lung tissue features make this task more challenging. By using large receptive fields from large convolutional kernels, convolutional neural networks (CNNs) can achieve higher segmentation accuracies with fewer parameters. However, due to the fixed size of the convolutional kernel, CNNs still struggle to extract multi-scale features for lung nodules of varying sizes. In this study, we propose a novel network to improve the segmentation accuracy of lung nodules. The network integrates adaptive large kernel attention (ALK) blocks, employing multiple convolutional layers with variously sized convolutional kernels and expansion rates to extract multi-scale features. A dynamic selection mechanism is also introduced to aggregate the multi-scale features obtained from variously sized convolutional kernels based on selection weights. Based on this, we propose a lightweight convolutional neural network with large convolutional kernels, called ALKU-Net, which integrates the ALKA module in a hierarchical encoder and adopts a U-shaped decoder to form a novel architecture. ALKU-Net efficiently utilizes the multi-scale large receptive field and enhances the model perception capability through spatial attention and channel attention. Extensive experiments demonstrate that our method outperforms other state-of-the-art models on the public dataset LUNA-16, exhibiting considerable accuracy in the lung nodule segmentation task.
Topics

No keywords indexed for this article. Browse by subject →

References
30
[1]
Dizon "Cancer statistics 2024: All hands on deck" CA A Cancer J. Clin. (2024) 10.3322/caac.21824
[2]
Cancer incidence and mortality in China, 2016

Rongshou Zheng, Siwei Zhang, Hongmei Zeng et al.

Journal of the National Cancer Center 2022 10.1016/j.jncc.2022.02.002
[3]
Infante "A randomized study of lung cancer screening with spiral computed tomography: Three-year results from the DANTE trial" Am. J. Respir. Crit. Care Med. (2009) 10.1164/rccm.200901-0076oc
[4]
MacMahon "Guidelines for management of small pulmonary nodules detected on CT scans: A statement from the Fleischner Society" Radiology (2005) 10.1148/radiol.2372041887
[5]
Li, R., Xiao, C., Huang, Y., Hassan, H., and Huang, B. (2022). Deep learning applications in computed tomography images for pulmonary nodule detection and diagnosis: A review. Diagnostics, 12. 10.3390/diagnostics12020298
[6]
Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany. Proceedings, Part III 18.
[7]
Dehmeshki "Segmentation of pulmonary nodules in thoracic CT scans: A region growing approach" IEEE Trans. Med. Imaging (2008) 10.1109/tmi.2007.907555
[8]
Rendon-Gonzalez, E., and Ponomaryov, V. (2016, January 20–24). Automatic Lung nodule segmentation and classification in CT images based on SVM. Proceedings of the 2016 9th International Kharkiv Symposium on Physics and Engineering of Microwaves, Millimeter and Submillimeter Waves (MSMW), Kharkiv, Ukraine. 10.1109/msmw.2016.7537995
[9]
Lavanya "Lung lesion detection in CT scan images using the fuzzy local information cluster means (FLICM) automatic segmentation algorithm and back propagation network classification" Asian Pac. J. Cancer Prev. APJCP (2017)
[10]
Su, R., Zhang, D., Liu, J., and Cheng, C. (2021). Msu-net: Multi-scale u-net for 2d medical image segmentation. Front. Genet., 12. 10.3389/fgene.2021.639930
[11]
Wang "Central focused convolutional neural networks: Developing a data-driven model for lung nodule segmentation" Med. Image Anal. (2017) 10.1016/j.media.2017.06.014
[12]
Zhou, Z., Rahman Siddiquee, M.M., Tajbakhsh, N., and Liang, J. (2018, January 20). Unet++: A nested u-net architecture for medical image segmentation. Proceedings of the Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain. Proceedings 4.
[13]
Huang, H., Lin, L., Tong, R., Hu, H., Zhang, Q., Iwamoto, Y., Han, X., Chen, Y.W., and Wu, J. (2020, January 4–8). Unet 3+: A full-scale connected unet for medical image segmentation. Proceedings of the ICASSP 2020–2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain. 10.1109/icassp40776.2020.9053405
[14]
Yue "Boundary refinement network for colorectal polyp segmentation in colonoscopy images" IEEE Signal Process. Lett. (2024) 10.1109/lsp.2024.3378106
[15]
Çiçek, Ö., Abdulkadir, A., Lienkamp, S.S., Brox, T., and Ronneberger, O. (2016, January 17–21). 3D U-Net: Learning dense volumetric segmentation from sparse annotation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2016: 19th International Conference, Athens, Greece. Proceedings, Part II 19. 10.1007/978-3-319-46723-8_49
[16]
Liu "A cascaded dual-pathway residual network for lung nodule segmentation in CT images" Phys. Medica (2019) 10.1016/j.ejmp.2019.06.003
[17]
Agnes "Efficient multiscale fully convolutional UNet model for segmentation of 3D lung nodule from CT image" J. Med. Imaging (2022) 10.1117/1.jmi.9.5.052402
[18]
Tyagi, S., and Talbar, S.N. (2022). CSE-GAN: A 3D conditional generative adversarial network with concurrent squeeze-and-excitation blocks for lung nodule segmentation. Comput. Biol. Med., 147. 10.1016/j.compbiomed.2022.105781
[19]
Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A.L., and Zhou, Y. (2021). Transunet: Transformers make strong encoders for medical image segmentation. arXiv.
[20]
Hatamizadeh, A., Nath, V., Tang, Y., Yang, D., Roth, H.R., and Xu, D. (2021, January 27). Swin unetr: Swin transformers for semantic segmentation of brain tumors in mri images. Proceedings of the International MICCAI Brainlesion Workshop, Virtual Event. 10.1007/978-3-031-08999-2_22
[21]
Li, H., Nan, Y., and Yang, G. (2022, January 27–29). LKAU-Net: 3D large-kernel attention-based u-net for automatic MRI brain tumor segmentation. Proceedings of the Annual Conference on Medical Image Understanding and Analysis, Cambridge, UK. 10.1007/978-3-031-12053-4_24
[22]
Han "ConvUNeXt: An efficient convolution neural network for medical image segmentation" Knowl.-Based Syst. (2022) 10.1016/j.knosys.2022.109512
[23]
Lee, H.H., Bao, S., Huo, Y., and Landman, B.A. (2022). 3D ux-net: A large kernel volumetric convnet modernizing hierarchical transformer for medical image segmentation. arXiv.
[24]
Visual attention network

Meng-Hao Guo, Cheng-Ze Lu, Zheng-Ning Liu et al.

Computational Visual Media 2023 10.1007/s41095-023-0364-2
[25]
Woo, S., Debnath, S., Hu, R., Chen, X., Liu, Z., Kweon, I.S., and Xie, S. (2023, January 17–24). Convnext v2: Co-designing and scaling convnets with masked autoencoders. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada. 10.1109/cvpr52729.2023.01548
[26]
Setio "Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge" Med. Image Anal. (2017) 10.1016/j.media.2017.06.015
[28]
Zhou, H.Y., Guo, J., Zhang, Y., Yu, L., Wang, L., and Yu, Y. (2021). nnformer: Interleaved transformer for volumetric segmentation. arXiv.
[29]
Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., Roth, H.R., and Xu, D. (2022, January 3–8). Unetr: Transformers for 3d medical image segmentation. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA. 10.1109/wacv51458.2022.00181
[30]
Huang, Z., Wang, H., Deng, Z., Ye, J., Su, Y., Sun, H., He, J., Gu, Y., Gu, L., and Zhang, S. (2023). Stu-net: Scalable and transferable medical image segmentation models empowered by large-scale supervised pre-training. arXiv.
Metrics
8
Citations
30
References
Details
Published
Aug 07, 2024
Vol/Issue
13(16)
Pages
3121
License
View
Cite This Article
Juepu Chen, Shuxian Liu, Yulong Liu (2024). ALKU-Net: Adaptive Large Kernel Attention Convolution Network for Lung Nodule Segmentation. Electronics, 13(16), 3121. https://doi.org/10.3390/electronics13163121
Related

You May Also Like

Machine Learning Interpretability: A Survey on Methods and Metrics

Diogo V. Carvalho, Eduardo M. Pereira · 2019

1,384 citations

The k-means Algorithm: A Comprehensive Survey and Performance Evaluation

Mohiuddin Ahmed, Raihan Seraj · 2020

1,342 citations

Sentiment Analysis Based on Deep Learning: A Comparative Study

Nhan Cach Dang, María N. Moreno-García · 2020

550 citations