journal article Jul 21, 2021

Automatic Extraction of Lung Cancer Staging Information From Computed Tomography Reports: Deep Learning Approach

Abstract
Background
Lung cancer is the leading cause of cancer deaths worldwide. Clinical staging of lung cancer plays a crucial role in making treatment decisions and evaluating prognosis. However, in clinical practice, approximately one-half of the clinical stages of lung cancer patients are inconsistent with their pathological stages. As one of the most important diagnostic modalities for staging, chest computed tomography (CT) provides a wealth of information about cancer staging, but the free-text nature of the CT reports obstructs their computerization.


Objective
We aimed to automatically extract the staging-related information from CT reports to support accurate clinical staging of lung cancer.


Methods
In this study, we developed an information extraction (IE) system to extract the staging-related information from CT reports. The system consisted of the following three parts: named entity recognition (NER), relation classification (RC), and postprocessing (PP). We first summarized 22 questions about lung cancer staging based on the TNM staging guideline. Next, three state-of-the-art NER algorithms were implemented to recognize the entities of interest. Next, we designed a novel RC method using the relation sign constraint (RSC) to classify the relations between entities. Finally, a rule-based PP module was established to obtain the formatted answers using the results of NER and RC.


Results
We evaluated the developed IE system on a clinical data set containing 392 chest CT reports collected from the Department of Thoracic Surgery II in the Peking University Cancer Hospital. The experimental results showed that the bidirectional encoder representation from transformers (BERT) model outperformed the iterated dilated convolutional neural networks-conditional random field (ID-CNN-CRF) and bidirectional long short-term memory networks-conditional random field (Bi-LSTM-CRF) for NER tasks with macro-F1 scores of 80.97% and 90.06% under the exact and inexact matching schemes, respectively. For the RC task, the proposed RSC showed better performance than the baseline methods. Further, the BERT-RSC model achieved the best performance with a macro-F1 score of 97.13% and a micro-F1 score of 98.37%. Moreover, the rule-based PP module could correctly obtain the formatted results using the extractions of NER and RC, achieving a macro-F1 score of 94.57% and a micro-F1 score of 96.74% for all the 22 questions.


Conclusions
We conclude that the developed IE system can effectively and accurately extract information about lung cancer staging from CT reports. Experimental results show that the extracted results have significant potential for further use in stage verification and prediction to facilitate accurate clinical staging.
Topics

No keywords indexed for this article. Browse by subject →

References
52
[1]
Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries

Freddie Bray, Jacques Ferlay, Isabelle Soerjomataram et al.

CA: A Cancer Journal for Clinicians 10.3322/caac.21492
[2]
EttingerDWoodDAggarwalCAisnerDAkerleyWBaumanJBharatABrunoDChangJChirieacLD'AmicoTDillingTDobelbowerMGettingerSGovindanRGubensMHennonMHornLLacknerRLanutiMLealTLinJLooBMartinsROttersonGPatelSReckampKRielyGSchildSShapiroTStevensonJSwansonSTauerKYangSGregoryKHughesMNCCN clinical practice guidelines in oncologyNon-Small Cell Lung Cancer2019-09-16https://www.nccn.org/guidelines/guidelines-detail?category=1&id=1450
[5]
WoodDKazerooniEBaumSEapenGEttingerDFergusonJHouLKlippensteinDKumarRLacknerRLeardLLennesILeungAMassionPMazzonePMerrittRMidthunDOnaitisMPipavathSPrattCPuriVReddyCReidMRotterASachsPSandsJSchahathMTanoueLTongBTravisWVachaniAWeiBYangSNCCN clinical practice guidelines in oncologyLung Cancer Screening2019-09-16https://www.nccn.org/guidelines/guidelines-detail?category=2&id=1441
[7]
Natural Language Processing of Clinical Notes on Chronic Diseases: Systematic Review

Seyedmostafa Sheikhalishahi, Riccardo Miotto, Joel T Dudley et al.

JMIR Medical Informatics 10.2196/12239
[10]
Huang, Z ArXiv.
[11]
Devlin, J ArXiv.
[12]
A frame semantic overview of NLP-based information extraction for cancer-related EHR notes

Surabhi Datta, Elmer V. Bernstam, Kirk Roberts

Journal of Biomedical Informatics 10.1016/j.jbi.2019.103301
[18]
AAlAbdulsalam, AK AMIA Jt Summits Transl Sci Proc (2018)
[23]
Yim, W AMIA Jt Summits Transl Sci Proc (2016)
[28]
Zhang, D ArXiv.
[31]
ZengDLiuKLaiSZhouGZhaoJRelation classification via convolutional deep neural network2014The 25th International Conference on Computational LinguisticsAugust 23-29, 2014Dublin, IrelandDublin, IrelandDublin City University and Association for Computational Linguistics23352344
[34]
Si, Y AMIA Annu Symp Proc (2018)
[37]
StenetorpPPyysaloSTopićGOhtaTAnaniadouSTsujiiJbrat: a web-based tool for NLP-assisted text annotationProceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics2012The 13th Conference of the European Chapter of the Association for Computational LinguisticsApril 23-27, 2012Avignon, FranceAssociation for Computational Linguistics102107
[38]
Mikolov, T ArXiv.
[39]
SunJjiebaJieba Chinese word segmentation module2021-07-03https://github.com/fxsjy/jieba
[43]
EliIE: An open-source information extraction system for clinical trial eligibility criteria

Tian Kang, Shaodian Zhang, Youlan Tang et al.

Journal of the American Medical Informatics Associ... 10.1093/jamia/ocx019
[45]
Yu, F arXiv e-prints (2015)
[46]
Vaswani, A ArXiv.
[48]
MintzMBillsSSnowRJurafskyDDistant supervision for relation extraction without labeled dataProceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP200908The Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLPAug 7-12, 2009Suntec, SingaporeAssociation for Computational Linguistics10031011 10.3115/1690219.1690287

Showing 50 of 52 references

Metrics
28
Citations
52
References
Details
Published
Jul 21, 2021
Vol/Issue
9(7)
Pages
e27955
Cite This Article
Danqing Hu, Huanyao Zhang, Shaolei Li, et al. (2021). Automatic Extraction of Lung Cancer Staging Information From Computed Tomography Reports: Deep Learning Approach. JMIR Medical Informatics, 9(7), e27955. https://doi.org/10.2196/27955