Multi task opinion enhanced hybrid BERT model for mental health analysis

Ghani, N. A., Hamid, S., Hashem, I. A. T. & Ahmed, E. Social media big data analytics: A survey. Comput. Hum. Behav. 101, 417–428 (2019). 10.1016/j.chb.2018.08.039

[3]

Kusal, S. et al. A systematic review of applications of natural language processing and future challenges with special emphasis in text-based emotion detection. Artif. Intell. Rev. 56, 15129–15215 (2023). 10.1007/s10462-023-10509-0

[4]

Fudholi, D. H. Mental health prediction model on social media data using CNN-BILSTM. In Kinetik: Game technology, information system, computer network, computing, electronics, and control 29–44 (2024).

[5]

Gratch, J. & Marsella, S. A domain-independent framework for modeling emotion. Cogn. Syst. Res. 5, 269–306 (2004). 10.1016/j.cogsys.2004.02.002

[6]

Suleiman, S. R. & Crosman, I. (eds.) The reader in the text: Essays on audience and interpretation, Vol. 617 (Princeton University Press, 2014).

[7]

Dogra, V. et al. A complete process of text classification system using state-of-the-art NLP models. Comput. Intell. Neurosci. 2022, 1883698 (2022). 10.1155/2022/1883698

[8]

Acheampong, F. A., Nunoo-Mensah, H. & Chen, W. Transformer models for text-based emotion detection: A review of BERT-based approaches. Artif. Intell. Rev. 54, 5789–5829 (2021). 10.1007/s10462-021-09958-2

[9]

Devlin, J., Chang, M., Lee, K. & Toutanova, K. BERT: pre-training of deep bidirectional transformers for language understanding. CoRRabs/1810.04805 (2018). arXiv:1810.04805.

[10]

Liu, Y. et al. Roberta: A robustly optimized BERT pretraining approach. CoRRabs/1907.11692 (2019). arXiv:1907.11692.

[11]

Sanh, V., Debut, L., Chaumond, J. & Wolf, T. Distilbert, a distilled version of BERT: Smaller, faster, cheaper and lighter (2020). arXiv:1910.01108.

[12]

Singh, A. The early detection and diagnosis of mental health status employing NLP-based methods with ml classifiers. J. Mental Health Technol. 12, 45–60 (2024).

[13]

Inamdar, S., Chapekar, R., Gite, S. & Pradhan, B. Machine learning driven mental stress detection on reddit posts using natural language processing. Hum.-Centric Intell. Syst. 3, 80–91 (2023). 10.1007/s44230-023-00020-8

[14]

Alanazi, S. A. et al. Public’s mental health monitoring via sentimental analysis of financial text using machine learning techniques. Int. J. Environ. Res. Public Health 19, 9695 (2022). 10.3390/ijerph19159695

[15]

Abd Rahman, R., Omar, K., Noah, S. A. M., Danuri, M. S. N. M. & Al-Garadi, M. A. Application of machine learning methods in mental health detection: A systematic review. IEEE Access 8, 183952–183964 (2020). 10.1109/access.2020.3029154

[16]

Abdulsalam, A., Alhothali, A. & Al-Ghamdi, S. Detecting suicidality in Arabic tweets using machine learning and deep learning techniques. Arabian J. Sci. Eng. 1–14 (2024). 10.1007/s13369-024-08767-3

[17]

Almeqren, M. A., Almuqren, L., Alhayan, F., Cristea, A. I. & Pennington, D. Using deep learning to analyze the psychological effects of COVID-19. Front. Psychol. 14, 962854 (2023). 10.3389/fpsyg.2023.962854

[18]

Ameer, I., Arif, M., Sidorov, G., Gómez-Adorno, H. & Gelbukh, A. Mental illness classification on social media texts using deep learning and transfer learning. arXiv preprint arXiv:2207.01012 (2022).

[19]

Su, C., Xu, Z., Pathak, J. & Wang, F. Deep learning in mental health outcome research: A scoping review. Transl. Psychiatr 10, 116 (2020). 10.1038/s41398-020-0780-3

[20]

Liu, J. & Su, M. Enhancing mental health condition detection on social media through multi-task learning. medRxiv 2024–02 (2024). 10.2139/ssrn.4747385

[21]

Multi-task learning to detect suicide ideation and mental disorders among social media users

Prasadith Buddhitha, Diana Inkpen

Frontiers in Research Metrics and Analytics 2023 10.3389/frma.2023.1152535

[22]

Sarkar, S., Alhamadani, A., Alkulaib, L. & Lu, C. T. Predicting depression and anxiety on reddit: a multi-task learning approach. In 2022 IEEE/ACM international conference on advances in social networks analysis and mining (ASONAM), 427–435 (IEEE, 2022). 10.1109/asonam55673.2022.10068655

[23]

Li, C., Braud, C. & Amblard, M. Multi-task learning for depression detection in dialogs. arXiv preprint arXiv:2208.10250 (2022). 10.18653/v1/2022.sigdial-1.7

[24]

Plaza-Del-Arco, F. M., Molina-González, M. D., Ureña-López, L. A. & Martín-Valdivia, M. T. A multi-task learning approach to hate speech detection leveraging sentiment analysis. IEEE Access 9, 112478–112489 (2021). 10.1109/access.2021.3103697

[25]

Jin, N., Wu, J., Ma, X., Yan, K. & Mo, Y. Multi-task learning model based on multi-scale CNN and LSTM for sentiment classification. IEEE Access 8, 77060–77072 (2020). 10.1109/access.2020.2989428

[26]

Malik, S. et al. Attention-aware with stacked embedding for sentiment analysis of student feedback through deep learning techniques. PeerJ Comput. Sci. 10, e2283 (2024). 10.7717/peerj-cs.2283

[27]

Chen, N., Sun, Y. & Yan, Y. Sentiment analysis and research based on two-channel parallel hybrid neural network model with attention mechanism. IET Control Theory Appl. 17, 2259–2267 (2023). 10.1049/cth2.12463

[28]

Tiwari, D. & Nagpal, B. Keaht: A knowledge-enriched attention-based hybrid transformer model for social sentiment analysis. N. Gener. Comput. 40, 1165–1202 (2022). 10.1007/s00354-022-00182-2

[29]

Huang, F. et al. Attention-emotion-enhanced convolutional lstm for sentiment analysis. IEEE Trans. Neural Netw. Learn. Syst. 33, 4332–4345 (2021). 10.1109/tnnls.2021.3056664

[30]

Han, W. & Kando, N. Opinion mining with deep contextualized embeddings. In Proceedings of the 2019 conference of the north american chapter of the association for computational linguistics: student research workshop, 35–42 (2019). 10.18653/v1/n19-3006

[31]

Jebbara, S. & Cimiano, P. Improving opinion-target extraction with character-level word embeddings. arXiv preprint arXiv:1709.06317 (2017). 10.18653/v1/w17-4124

[32]

Liu, P., Joty, S. & Meng, H. Fine-grained opinion mining with recurrent neural networks and word embeddings. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 1433–1443 (2015). 10.18653/v1/d15-1168

[33]

Gudivada, V., Apon, A. & Ding, J. Data quality considerations for big data and machine learning: Going beyond data cleaning and transformations. Int. J. Adv. Softw. 10, 1–20 (2017).

[34]

Vatri, A. & McGillivray, B. Lemmatization for ancient greek: An experimental assessment of the state of the art. J. Greek Linguistics 20, 179–196 (2020). 10.1163/15699846-02002001

[35]

Bondugula, R., Udgata, S., Rahman, N. & Sivangi, K. Intelligent analysis of multimedia healthcare data using natural language processing and deep-learning techniques. In Edge-of-things in personalized healthcare support systems, 335–358 (Academic Press, 2022). 10.1016/b978-0-323-90585-5.00014-x

[36]

Xiang, L., Li, Y., Hao, W., Yang, P. & Shen, X. Reversible natural language watermarking using synonym substitution and arithmetic coding. Comput. Mater. Continua 55, 541–559. https://doi.org/10.3970/cmc.2018.03510 (2018). 10.3970/cmc.2018.03510

[37]

Michalopoulos, G., McKillop, I., Wong, A. & Chen, H. Lexsubcon: Integrating knowledge from lexical resources into contextual embeddings for lexical substitution. arXiv preprint arXiv:2107.05132 (2021). 10.18653/v1/2022.acl-long.87

[38]

Huang, K., Geller, J., Halper, M., Perl, Y. & Xu, J. Using wordnet synonym substitution to enhance UMLS source integration. Artif. Intell. Med. 46, 97–109 (2009). 10.1016/j.artmed.2008.11.008

[39]

Hermansyah, R. & Sarno, R. Sentiment analysis about product and service evaluation of pt telekomunikasi indonesia tbk from tweets using textblob, naive bayes & k-nn method. In 2020 international seminar on application for technology of information and communication (iSemantic), 511–516 (IEEE, 2020). 10.1109/isemantic50169.2020.9234238

[40]

Hilal, A. & Chachoo, M. A. Aspect based opinion mining of online reviews. Gedrag Organisatie Rev. 33, 1185–1199 (2020). 10.37896/gor33.03/500

[41]

Meng, Y. et al. Text classification using label names only: A language model self-training approach. arXiv preprint arXiv:2010.07245 (2020). arXiv:2010.07245. 10.18653/v1/2020.emnlp-main.724

[42]

Kokane, V., Abhyankar, A., Shrirao, N. & Khadkikar, P. Predicting mental illness (depression) with the help of nlp transformers. In 2024 second international conference on data science and information system (ICDSIS), 1–5 (IEEE, 2024). 10.1109/icdsis61070.2024.10594036

[43]

Chen, N., Sun, Y. & Yan, Y. Sentiment analysis and research based on two-channel parallel hybrid neural network model with attention mechanism. IET Control Theory Appl. 17, 2259–2267 (2023). 10.1049/cth2.12463

[44]

Selva Mary, G. et al. Enhancing conversational sentimental analysis for psychological depression prediction with BI-LSTM. J. Autonomous Intell., 7 (2023). 10.32629/jai.v7i1.1116

[45]

Sowbarnigaa, K. S. et al. Leveraging multi-class sentiment analysis on social media text for detecting signs of depression. Appl. Comput. Eng. 2, 1020–1029. https://doi.org/10.54254/2755-2721/2/20220660 (2023). 10.54254/2755-2721/2/20220660

[46]

Atapattu, T. et al. Emoment: An emotion annotated mental health corpus from two south asian countries. arXiv preprint arXiv:2208.08486 (2022).

[47]

Wu, Z., Ying, C., Dai, X., Huang, S. & Chen, J. Transformer-based multi-aspect modeling for multi-aspect multi-sentiment analysis. In Natural Language Processing and Chinese Computing: 9th CCF International Conference, NLPCC 2020, Zhengzhou, China, October 14–18, 2020, Proceedings, Part II, 546–557 (Springer International Publishing, 2020). 10.1007/978-3-030-60457-8_45

Metrics

32

Citations

47

References

Details

Published: Jan 27, 2025
Vol/Issue: 15(1)
License: View

Authors

Department of Computer Science and Engineering, American International University-Bangladesh, Dhaka, Bangladesh

M

Mejdl Safran

Department of Computer Science, College of Computer and Information Sciences, King Saud University, P.O. Box 51178, Riyadh 11543, Saudi Arabia

S

Sultan Alfarhood

Department of Computer Science, College of Computer and Information Sciences, King Saud University, P.O. Box 51178, Riyadh 11543, Saudi Arabia

Funding

King Saud University

Cite This Article

Md. Shakil Hossain, M. F. Mridha, Mejdl Safran, et al. (2025). Multi task opinion enhanced hybrid BERT model for mental health analysis. Scientific Reports, 15(1). https://doi.org/10.1038/s41598-025-86124-6

Multi task opinion enhanced hybrid BERT model for mental health analysis

You May Also Like