Image fusion of mass spectrometry and microscopy: a multimodality paradigm for molecular tissue mapping

Raf Van de Plas; Junhai Yang; Jeffrey Spraggins; Richard M Caprioli

doi:10.1038/nmeth.3296

journal article Feb 23, 2015

Image fusion of mass spectrometry and microscopy: a multimodality paradigm for molecular tissue mapping

Raf Van de Plas Junhai Yang Jeffrey Spraggins Richard M Caprioli

Nature Methods Vol. 12 No. 4 pp. 366-372 · Springer Science and Business Media LLC

View at Publisher Save 10.1038/nmeth.3296

Topics

No keywords indexed for this article. Browse by subject →

References

40

[1]

Weissleder, R. Scaling down imaging: molecular mapping of cancer in mice. Nat. Rev. Cancer 2, 11–18 (2002). 10.1038/nrc701

[2]

Massoud, T.F. & Gambhir, S.S. Molecular imaging in living subjects: seeing fundamental biological processes in a new light. Genes Dev. 17, 545–580 (2003). 10.1101/gad.1047403

[3]

Jahn, K.A. et al. Correlative microscopy: providing new understanding in the biomedical and plant sciences. Micron 43, 565–582 (2012). 10.1016/j.micron.2011.12.004

[4]

Jacobs, R.E. & Cherry, S.R. Complementary emerging techniques: high-resolution PET and MRI. Curr. Opin. Neurobiol. 11, 621–629 (2001). 10.1016/s0959-4388(00)00259-2

[5]

Chughtai, S. et al. A multimodal mass spectrometry imaging approach for the study of musculoskeletal tissues. Int. J. Mass Spectrom. 325–327, 150–160 (2012). 10.1016/j.ijms.2012.07.008

[6]

Smith, C. Two microscopes are better than one. Nature 492, 293–297 (2012). 10.1038/492293a

[7]

Caplan, J., Niethammer, M., Taylor, R.M. II. & Czymmek, K.J. The power of correlative microscopy: multi-modal, multi-scale, multi-dimensional. Curr. Opin. Struct. Biol. 21, 686–693 (2011). 10.1016/j.sbi.2011.06.010

[8]

Modla, S. & Czymmek, K.J. Correlative microscopy: a powerful tool for exploring neurological cells and tissues. Micron 42, 773–792 (2011). 10.1016/j.micron.2011.07.001

[9]

Townsend, D.W. A combined PET/CT scanner: the choices. J. Nucl. Med. 42, 533–534 (2001).

[10]

Townsend, D.W., Beyer, T. & Blodgett, T.M. PET/CT scanners: a hardware approach to image fusion. Semin. Nucl. Med. 33, 193–204 (2003). 10.1053/snuc.2003.127314

[11]

Masyuko, R., Lanni, E.J., Sweedler, J.V. & Bohn, P.W. Correlated imaging - a grand challenge in chemical analysis. Analyst 138, 1924–1939 (2013). 10.1039/c3an36416j

[12]

Bocklitz, T.W. et al. Deeper understanding of biological tissue: quantitative correlation of MALDI-TOF and Raman imaging. Anal. Chem. 85, 10829–10834 (2013). 10.1021/ac402175c

[13]

Clarke, F.C. et al. Chemical image fusion. The synergy of FT-NIR and Raman mapping microscopy to enable a more complete visualization of pharmaceutical formulations. Anal. Chem. 73, 2213–2220 (2001). 10.1021/ac001327l

[14]

Judenhofer, M.S. et al. Simultaneous PET-MRI: a new approach for functional and morphological imaging. Nat. Med. 14, 459–465 (2008). 10.1038/nm1700

[15]

Glenn, D.R. et al. Correlative light and electron microscopy using cathodoluminescence from nanoparticles with distinguishable colours. Sci. Rep. 2, 865 (2012). 10.1038/srep00865

[16]

Josephson, L., Kircher, M.F., Mahmood, U., Tang, Y. & Weissleder, R. Near-infrared fluorescent nanoparticles as combined MR/optical imaging probes. Bioconjug. Chem. 13, 554–560 (2002). 10.1021/bc015555d

[17]

Blum, R.S. & Liu, Z. Multi-sensor Image Fusion and Its Applications (CRC Press, 2005).

[18]

Bretschneider, T. & Kao, O. in Proc. 1st Online Symp. Electron. Eng. 1–8 (2000).

[19]

Pohl, C. & Van Genderen, J.L. Multisensor image fusion in remote sensing: concepts, methods and applications. Int. J. Remote Sens. 19, 823–854 (1998). 10.1080/014311698215748

[20]

Price, J.C. Combining multispectral data of differing spatial resolution. IEEE Trans. Geosci. Rem. Sens. 37, 1199–1203 (1999). 10.1109/36.763272

[21]

Simone, G., Farina, A., Morabito, F.C., Serpico, S.B. & Bruzzone, L. Image fusion techniques for remote sensing applications. Inf. Fusion 3, 3–15 (2002). 10.1016/s1566-2535(01)00056-2

[22]

Gaemperli, O. et al. Cardiac image fusion from stand-alone SPECT and CT: clinical experience. J. Nucl. Med. 48, 696–703 (2007). 10.2967/jnumed.106.037606

[23]

Li, H. et al. Object recognition in brain CT-scans: knowledge-based fusion of data from multiple feature extractors. IEEE Trans. Med. Imaging 14, 212–229 (1995). 10.1109/42.414622

[24]

Yang, L., Guo, B.L. & Ni, W. Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform. Neurocomputing 72, 203–211 (2008). 10.1016/j.neucom.2008.02.025

[25]

Varshney, P.K. et al. in Proc. Int. Conf. Image Proc. 3, 532–536 (IEEE, 1999).

[26]

Caprioli, R.M., Farmer, T.B. & Gile, J. Molecular imaging of biological samples: localization of peptides and proteins using MALDI-TOF MS. Anal. Chem. 69, 4751–4760 (1997). 10.1021/ac970888i

[27]

Imaging mass spectrometry: A new technology for the analysis of protein expression in mammalian tissues

Markus Stoeckli, Pierre Chaurand, Dennis E. Hallahan et al.

Nature Medicine 2001 10.1038/86573

[28]

Amstalden van Hove, E.R., Smith, D.F. & Heeren, R. A concise review of mass spectrometry imaging. J. Chromatogr. A 1217, 3946–3954 (2010). 10.1016/j.chroma.2010.01.033

[29]

Chaurand, P. Imaging mass spectrometry of thin tissue sections: a decade of collective efforts. J. Proteomics 75, 4883–4892 (2012). 10.1016/j.jprot.2012.04.005

[30]

Norris, J.L. & Caprioli, R.M. Analysis of tissue specimens by matrix-assisted laser desorption/ionization imaging mass spectrometry in biological and clinical research. Chem. Rev. 113, 2309–2342 (2013). 10.1021/cr3004295

[31]

Murphy, R.C., Hankin, J.A. & Barkley, R.M. Imaging of lipid species by MALDI mass spectrometry. J. Lipid Res. 50, S317–S322 (2009). 10.1194/jlr.r800051-jlr200

[32]

Van de Plas, R. Tissue Based Proteomics and Biomarker Discovery – Multivariate Data Mining Strategies for Mass Spectral Imaging. PhD thesis, KU Leuven (2010).

[33]

Andersson, M., Andren, P. & Caprioli, R.M. in Neuroproteomics (ed. Azalte, O.) Ch. 7, 115–134 (CRC Press, 2009).

[34]

Franck, J. et al. MALDI mass spectrometry imaging of proteins exceeding 30,000 daltons. Med. Sci. Monit. 16, BR293–BR299 (2010).

[35]

Bradshaw, R., Bleay, S., Wolstenholme, R., Clench, M.R. & Francese, S. Towards the integration of matrix assisted laser desorption ionisation mass spectrometry imaging into the current fingermark examination workflow. Forensic Sci. Int. 232, 111–124 (2013). 10.1016/j.forsciint.2013.07.013

[36]

Chavez, P.S. Jr., Sides, S.C. & Anderson, J.A. Comparison of three different methods to merge multiresolution and multispectral data- Landsat TM and SPOT panchromatic. Photogramm. Eng. Remote Sensing 57, 295–303 (1991).

[37]

Garguet-Duport, B., Girel, J., Chassery, J.-M. & Patou, G. The use of multiresolution analysis and wavelets transform for merging SPOT panchromatic and multispectral image data. Photogramm. Eng. Remote Sensing 62, 1057–1066 (1996).

[38]

Lee, J. & Lee, C. Fast and efficient panchromatic sharpening. IEEE Trans. Geosci. Remote Sens. 48, 155–163 (2010). 10.1109/tgrs.2009.2028613

[39]

Draper, N.R., Smith, H. & Pownell, E. Applied Regression Analysis 1st edn. (Wiley, 1966).

[40]

PLS-regression: a basic tool of chemometrics

Svante Wold, Michael Sjöström, Lennart Eriksson

Chemometrics and Intelligent Laboratory Systems 2001 10.1016/s0169-7439(01)00155-1

Cited By

273

Mass spectrometry-based human spatial omics: fundamentals, innovations, and applications

Ching-Chia Yang, Ching-Ya Lin · 2026

Journal of Biomedical Science

Spatially Resolved Metabolomics Reveals Metabolic Heterogeneity Among Pulmonary Fibrosis

Shengxi Li, Cong Li · 2025

Journal of Mass Spectrometry

Powder particle classification with scanning electron microscopy images using machine learning techniques

Ivan Malashin, Dmitriy Martysyuk · 2025

Expert Systems with Applications

Recent advances in mass spectrometry imaging combined with artificial intelligence for spatially clarifying molecular profiles: Toward biomedical applications

Junyu Zhang, Caixia Yuan · 2024

TrAC Trends in Analytical Chemistry

Enhancement of Ambient Mass Spectrometry Imaging Data by Image Restoration

Yuchen Xiang, Martin Metodiev · 2023

Metabolites

A review on recent machine learning applications for imaging mass spectrometry studies

Albina Jetybayeva, Nikolay Borodinov · 2023

Journal of Applied Physics

Mass Spectrometry-Based Analysis of Lipid Involvement in Alzheimer’s Disease Pathology—A Review

Andrea R. Kelley · 2022

Metabolites

Spatially Resolved Mass Spectrometry at the Single Cell: Recent Innovations in Proteomics and Metabolomics

Michael J. Taylor, Jessica K. Lukowski · 2021

Journal of the American Society for...

Multimodal Imaging of Amyloid Plaques: Fusion of the Single-Probe Mass Spectrometry Image and Fluorescence Microscopy Image

Xiang Tian, Boer Xie · 2019

Analytical Chemistry

A patch-based super resolution algorithm for improving image resolution in clinical mass spectrometry

Klára Ščupáková, Vasilis Terzopoulos · 2019

Scientific Reports

Mass Spectrometry Imaging: A Review of Emerging Advancements and Future Insights

Amanda Rae Buchberger, Kellen DeLaney · 2017

Analytical Chemistry

Mass spectrometry imaging for plant biology: a review

Berin A. Boughton, Dinaiz Thinagaran · 2015

Phytochemistry Reviews

Metrics

273

Citations

40

References

Details

Published: Feb 23, 2015
Vol/Issue: 12(4)
Pages: 366-372
License: View

Authors

Cite This Article

Raf Van de Plas, Junhai Yang, Jeffrey Spraggins, et al. (2015). Image fusion of mass spectrometry and microscopy: a multimodality paradigm for molecular tissue mapping. Nature Methods, 12(4), 366-372. https://doi.org/10.1038/nmeth.3296

Image fusion of mass spectrometry and microscopy: a multimodality paradigm for molecular tissue mapping

You May Also Like