A Review of Medical Image Registration for Different Modalities

Fatemehzahra Darzi; Thomas Bocklitz

doi:10.3390/bioengineering11080786

journal article Open Access Aug 02, 2024

A Review of Medical Image Registration for Different Modalities

Fatemehzahra Darzi Thomas Bocklitz

Bioengineering Vol. 11 No. 8 pp. 786 · MDPI AG

View at Publisher Save 10.3390/bioengineering11080786

Abstract

Medical image registration has become pivotal in recent years with the integration of various imaging modalities like X-ray, ultrasound, MRI, and CT scans, enabling comprehensive analysis and diagnosis of biological structures. This paper provides a comprehensive review of registration techniques for medical images, with an in-depth focus on 2D-2D image registration methods. While 3D registration is briefly touched upon, the primary emphasis remains on 2D techniques and their applications. This review covers registration techniques for diverse modalities, including unimodal, multimodal, interpatient, and intra-patient. The paper explores the challenges encountered in medical image registration, including geometric distortion, differences in image properties, outliers, and optimization convergence, and discusses their impact on registration accuracy and reliability. Strategies for addressing these challenges are highlighted, emphasizing the need for continual innovation and refinement of techniques to enhance the accuracy and reliability of medical image registration systems. The paper concludes by emphasizing the importance of accurate medical image registration in improving diagnosis.

Topics

No keywords indexed for this article. Browse by subject →

References

53

[1]

Li "A robust registration algorithm for image-guided surgical robot" IEEE Access (2018) 10.1109/access.2018.2853601

[2]

Hammoudeh, A., and Dupont, S. (2024). Deep learning in medical image registration: Introduction and survey. arXiv. 10.32388/jre35j

[3]

Baum "Meta-Learning Initializations for Interactive Medical Image Registration" IEEE Trans. Med. Imaging (2022) 10.1109/tmi.2022.3218147

[4]

Liu "Image Registration in Medical Robotics and Intelligent Systems: Fundamentals and Applications" Adv. Intell. Syst. (2019) 10.1002/aisy.201900048

[5]

Chaabane "A Systematic Literature Review on Multi-modal Medical Image Registration" Proceedings of the Service-Oriented Computing—ICSOC 2022 Workshops (2023)

[6]

Jiang "A review of multimodal image matching: Methods and applications" Inf. Fusion (2021) 10.1016/j.inffus.2021.02.012

[7]

Deep learning in medical image registration: a review

Yabo Fu, Yang Lei, Tonghe Wang et al.

Physics in Medicine & Biology 10.1088/1361-6560/ab843e

[8]

Boveiri "Medical Image Registration Using Deep Neural Networks: A Comprehensive Review" Comput. Electr. Eng. (2020) 10.1016/j.compeleceng.2020.106767

[9]

Tetar "Magnetic resonance-guided stereotactic radiotherapy for localized prostate cancer: Final results on patient-reported outcomes of a prospective phase 2 study" Eur. Urol. Oncol. (2021) 10.1016/j.euo.2020.05.007

[10]

Teatini, A., Pelanis, E., Aghayan, D.L., Kumar, R.P., Palomar, R., Fretland, Å.A., Edwin, B., and Elle, O.J. (2019). The effect of intraoperative imaging on surgical navigation for laparoscopic liver resection surgery. Sci. Rep., 9. 10.1038/s41598-019-54915-3

[11]

Nagaraju "Image Registration Using Scale Invariant Feature Transform" Int. J. Sci. Eng. Technol. (2013)

[12]

Dong, Y., Jiao, W., Long, T., He, G., and Gong, C. (2018). An Extension of Phase Correlation-Based Image Registration to Estimate Similarity Transform Using Multiple Polar Fourier Transform. Remote Sens., 10. 10.3390/rs10111719

[13]

Tondewad "Remote sensing image registration methodology: Review and discussion" Procedia Comput. Sci. (2020) 10.1016/j.procs.2020.04.259

[14]

Shaharom "Multispectral Image Matching Using SIFT and SURF Algorithm: A Review" Int. J. Geoinform. (2023)

[15]

Niethammer, M., Kwitt, R., and Vialard, F.-X. (2019, January 15–20). Metric learning for image registration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA. 10.1109/cvpr.2019.00866

[16]

Hu "End-to-end multimodal image registration via reinforcement learning" Med. Image Anal. (2021) 10.1016/j.media.2020.101878

[17]

Soualmi "Artificial Bee Colony-Based Blind Watermarking Scheme for Color Images Alter Detection Using BRISK Features and DCT" Arab J. Sci. Eng. (2023) 10.1007/s13369-023-07958-8

[18]

Semma "Writer identification using deep learning with fast keypoints and harris corner detector" Expert Syst. Appl. (2021) 10.1016/j.eswa.2021.115473

[19]

Liu "A review of keypoints’ detection and feature description in image registration" Sci. Program. (2021)

[20]

Bedruz, R.A.R., Fernando, A., Bandala, A., Sybingco, E., and Dadios, E. (2018, January 28–31). Vehicle classification using AKAZE and feature matching approach and artificial neural network. Proceedings of the TENCON 2018—2018 IEEE Region 10 Conference, Jeju, Republic of Korea. 10.1109/tencon.2018.8650119

[21]

Bansal "2D object recognition: A comparative analysis of SIFT, SURF and ORB feature descriptors" Multimed. Tools Appl. (2021) 10.1007/s11042-021-10646-0

[22]

Zhang "Self-supervised Rigid Transformation Equivariance for Accurate 3D Point Cloud Registration" Pattern Recognit. (2022) 10.1016/j.patcog.2022.108784

[23]

Arora "An Adaptive Medical Image Registration Using Hybridization of Teaching Learning-Based Optimization with Affine and Speeded Up Robust Features with Projective Transformation" Cluster Comput. (2023) 10.1007/s10586-023-03974-3

[24]

Wu "Creating Panoramic Images Using ORB Feature Detection and RANSAC-Based Image Alignment" Adv. Comput. Commun. (2023) 10.26855/acc.2023.08.002

[25]

Rigaud "Deformable image registration for radiation therapy: Principle, methods, applications and evaluation" Acta Oncol. (2019) 10.1080/0284186x.2019.1620331

[26]

Saha "Color fundus image registration techniques and applications for automated analysis of diabetic retinopathy progression: A review" Biomed. Signal Process. Control (2019) 10.1016/j.bspc.2018.08.034

[27]

Zhao, P., Chen, X., Tang, S., Xu, Y., Yu, M., and Xu, P. (2022, January 5–9). Fast Recognition and Localization of Electric Vehicle Charging Socket Based on Deep Learning and Affine Correction. Proceedings of the 2022 IEEE International Conference on Robotics and Biomimetics (ROBIO), Jinghong, China. 10.1109/robio55434.2022.10011985

[28]

Khan "Multimodal Medical Image Fusion Towards Future Research: A Review" J. King Saud Univ.-Comput. Inf. Sci. (2023)

[29]

Song "A Review on Medical Image Registration as an Optimization Problem" Curr. Med. Imaging (2017)

[30]

Chaudhury "Multilevel Optimization for Registration of Deformable Point Clouds" IEEE Trans. Image Process. (2020) 10.1109/tip.2020.3019649

[31]

Tward, D.J. (2021). An Optical Flow Based Left-Invariant Metric for Natural Gradient Descent in Affine Image Registration. Front. Appl. Math. Stat., 7. 10.3389/fams.2021.718607

[32]

Dong "Accelerated Nonrigid Image Registration Using Improved Levenberg–Marquardt Method" Inf. Sci. (2018) 10.1016/j.ins.2017.09.059

[33]

Zitova "Image Registration Methods: A Survey" Image Vis. Comput. (2003) 10.1016/s0262-8856(03)00137-9

[34]

Elmogy "Current Trends in Medical Image Registration and Fusion" Egypt. Inform. J. (2016) 10.1016/j.eij.2015.09.002

[35]

Sabuncu, M.R. (2006). Entropy-Based Image Registration. [Ph.D. Dissertation, Princeton University].

[36]

Qiu, H., Qin, C., Schuh, A., Hammernik, K., and Rueckert, D. (2021, January 7–9). Learning Diffeomorphic and Modality-Invariant Registration Using B-Splines. Proceedings of the Medical Imaging with Deep Learning, Lübeck, Germany.

[37]

Nanavati "Performance Comparison of Different Wavelet-Based Image Fusion Techniques for Lumbar Spine Images" J. Integr. Sci. Technol. (2024)

[38]

Loi "Performance of Commercially Available Deformable Image Registration Platforms for Contour Propagation Using Patient-Based Computational Phantoms: A Multi-Institutional Study" Med. Phys. (2018) 10.1002/mp.12737

[39]

Haskins "Deep learning in medical image registration: A survey" Mach. Vis. Appl. (2020) 10.1007/s00138-020-01060-x

[40]

Chen, X., Diaz-Pinto, A., Ravikumar, N., and Frangi, A.F. (2021). Deep learning in medical image registration. Prog. Biomed. Eng., 3. 10.1088/2516-1091/abd37c

[41]

Ho, T.T., Kim, W.J., Lee, C.H., Jin, G.Y., Chae, K.J., and Choi, S. (2023). An Unsupervised Image Registration Method Employing Chest Computed Tomography Images and Deep Neural Networks. Comput. Biol. Med., 154. 10.1016/j.compbiomed.2023.106612

[42]

Arif "Fast Curvelet Transform through Genetic Algorithm for Multimodal Medical Image Fusion" Soft Comput. (2020) 10.1007/s00500-019-04011-5

[43]

Orujov "Fuzzy Based Image Edge Detection Algorithm for Blood Vessel Detection in Retinal Images" Appl. Soft Comput. (2020) 10.1016/j.asoc.2020.106452

[44]

Sun "An Automatic 3D Point Cloud Registration Method Based on Regional Curvature Maps" Image Vis. Comput. (2016) 10.1016/j.imavis.2016.09.002

[45]

Islam, K.T., Wijewickrema, S., and O’Leary, S. (2021). A Deep Learning Based Framework for the Registration of Three-Dimensional Multi-Modal Medical Images of the Head. Sci. Rep., 11. 10.1038/s41598-021-81044-7

[46]

Mahapatra, D., Antony, B., Sedai, S., and Garnavi, R. (2018, January 4–7). Deformable Medical Image Registration Using Generative Adversarial Networks. Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), Washington, DC, USA. 10.1109/isbi.2018.8363845

[47]

(2024, June 12). Scopus. Available online: https://www.scopus.com.

[48]

Alam "Medical Image Registration in Image Guided Surgery: Issues, Challenges and Research Opportunities" Biocybern. Biomed. Eng. (2018) 10.1016/j.bbe.2017.10.001

[49]

Faiza "A Review and Analysis of Image Misalignment Problem in Remote Sensing" Int. J. Sci. Eng. Res. (2012)

[50]

Noble "Multisite reliability of MR-based functional connectivity" Neuroimage. (2017) 10.1016/j.neuroimage.2016.10.020

Showing 50 of 53 references

Metrics

38

Citations

53

References

Details

Published: Aug 02, 2024
Vol/Issue: 11(8)
Pages: 786
License: View

Authors

F

Fatemehzahra Darzi

Institute of Physical Chemistry, Friedrich Schiller University Jena, Helmholtzweg 4, 07743 Jena, Germany

T

Thomas Bocklitz

Institute of Physical Chemistry, Friedrich Schiller University Jena, Helmholtzweg 4, 07743 Jena, Germany; Department of Photonic Data Science, Leibniz Institute of Photonic Technology, Albert-Einstein-Straße 9, 07745 Jena, Germany

Funding

European Union Award: 13N15706 (LPI-BT2-FSU)

BMBF funding program Photonics Research Germany Award: 13N15706 (LPI-BT2-FSU)

German Research Foundation Projekt-Nr Award: 13N15706 (LPI-BT2-FSU)

Cite This Article

Fatemehzahra Darzi, Thomas Bocklitz (2024). A Review of Medical Image Registration for Different Modalities. Bioengineering, 11(8), 786. https://doi.org/10.3390/bioengineering11080786

A Review of Medical Image Registration for Different Modalities

You May Also Like