Abstract
Sentiment analysis or opinion mining for subject information extraction from the text has become more and more dependent on natural language processing, especially for business and healthcare, since the online products and service reviews affect the consuming behaviors. Word embeddings that can map the words to low-dimensional vector representations have been widely used in natural language processing tasks. But the word embeddings based on context such as Word2Vec and GloVe fail to capture the sentiment information. Most of existing sentiment analysis methods incorporate emotional polarity (positive and negative) to improve the sentiment embeddings for the emotion classification. This article takes advantage of an emotional psychology model to learn the emotional embeddings in Chinese first. In order to combine the semantic space and an emotional space, we present two different purifying models from local (LPM) and global (GPM) perspectives based on Plutchik's wheel of emotions to add the emotional information into word vectors. The two models aim to improve the word vectors so that not only the semantically similar words but also the sentimentally similar words can be closer than before. The Plutchik's wheel of emotions model can give eight-dimensional vector for one word in emotional space that can capture more sentiment information than the binary polarity labels. The obvious advantage of the local purifying model is that it can be fit for any pretrained word embeddings. For the global purifying model, we can get the final emotional embeddings at once. These models have been extended to handle English texts. The experimental results on Chinese and English datasets show that our purifying model can improve the conventional word embeddings and some proposed sentiment embeddings for sentiment classification and multi-emotion classification.
Topics

No keywords indexed for this article. Browse by subject →

References
38
[1]
R. Plutchik. 2001. The nature of emotions. American Scientist 89(4). R. Plutchik. 2001. The nature of emotions. American Scientist 89(4). 10.1511/2001.4.344
[3]
R. Collobert and J. Weston . 2008. A unified architecture for natural language processing: Deep neural networks with multi task learning . In Proc. Int. Conf. Machine Learning. 160--167 . R. Collobert and J. Weston. 2008. A unified architecture for natural language processing: Deep neural networks with multi task learning. In Proc. Int. Conf. Machine Learning. 160--167.
[4]
A. Mnih and G. E. Hinton 2008. A scalable hierarchical distributed language model. Neural Information Processing Systems. 1081--1088. A. Mnih and G. E. Hinton 2008. A scalable hierarchical distributed language model. Neural Information Processing Systems. 1081--1088.
[5]
T. Mikolov , K. Chen , G. Corrado , and J. Dean . 2013. Efficient estimation of word representations in vector space . In Proceedings of the International Conference on Learning Representations. 1--12 . T. Mikolov, K. Chen, G. Corrado, and J. Dean. 2013. Efficient estimation of word representations in vector space. In Proceedings of the International Conference on Learning Representations. 1--12.
[6]
O. Levy and Y. Goldberg . 2014. Dependency-based word embeddings . In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) , Baltimore, Maryland, 302--308. O. Levy and Y. Goldberg. 2014. Dependency-based word embeddings. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Baltimore, Maryland, 302--308.
[7]
Y. Liu Z. Liu T.-S. Chua and M. Sun. 2015. Topical word embeddings. Association for the Advancement of Artificial Intelligence. 2418--2424. Y. Liu Z. Liu T.-S. Chua and M. Sun. 2015. Topical word embeddings. Association for the Advancement of Artificial Intelligence. 2418--2424.
[8]
A. L. Maas , R. E. Daly , P. T. Pham , D. Huang , A. Ng , and C. Potts . 2011. Learning word vectors for sentiment analysis . In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies , Portland, Oregon, 142--150. A. L. Maas, R. E. Daly, P. T. Pham, D. Huang, A. Ng, and C. Potts. 2011. Learning word vectors for sentiment analysis. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Portland, Oregon, 142--150.
[9]
I. Labutov and H. Lipson . 2013. Re-embedding words . In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Sofia, Bulgaria 489--493 . I. Labutov and H. Lipson. 2013. Re-embedding words. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Sofia, Bulgaria 489--493.
[11]
Y. Ren , Y. Zhang , M. Zhang , and D. Ji . 2016. Improving twitter sentiment classification using topic-enriched multi-prototype word embeddings . In Proceedings of the Association for the Advancement of Artificial Intelligence. 3038--3044 . Y. Ren, Y. Zhang, M. Zhang, and D. Ji. 2016. Improving twitter sentiment classification using topic-enriched multi-prototype word embeddings. In Proceedings of the Association for the Advancement of Artificial Intelligence. 3038--3044.
[12]
M. Lan , Z. Zhang , Y. Lu , and J. Wu . 2016. Three convolutional neural network based models for learning sentiment word vectors towards sentiment analysis . In Proceedings of the International Joint Conference on Neural Networks. 3172--3179 . M. Lan, Z. Zhang, Y. Lu, and J. Wu. 2016. Three convolutional neural network based models for learning sentiment word vectors towards sentiment analysis. In Proceedings of the International Joint Conference on Neural Networks. 3172--3179.
[13]
Carlo Strapparava and Alessandro Valitutti . 2004 . Wordnet affect: An affective extension of wordnet . In Proceedings of the International Conference on Language Resources and Evaluation. Carlo Strapparava and Alessandro Valitutti. 2004. Wordnet affect: An affective extension of wordnet. In Proceedings of the International Conference on Language Resources and Evaluation.
[17]
Munmun De Choudhury , Michael Gamon , and Scott Counts . 2012 . Happy, nervous or surprised? Classification of human affective states in social media . In Proceedings of the International Conference on Web and Social Media. Munmun De Choudhury, Michael Gamon, and Scott Counts. 2012. Happy, nervous or surprised? Classification of human affective states in social media. In Proceedings of the International Conference on Web and Social Media.
[18]
A Review on Multi-Label Learning Algorithms

Min-Ling Zhang, Zhi-Hua Zhou

IEEE Transactions on Knowledge and Data Engineerin... 10.1109/tkde.2013.39
[23]
R. Plutchik. 2005. Emotions and life: Perspectives from psychology biology and evolution. Psychology 8 Marketing. 97--101. R. Plutchik. 2005. Emotions and life: Perspectives from psychology biology and evolution. Psychology 8 Marketing. 97--101. 10.1002/mar.20048
[24]
R. Plutchik. 2002. Emotions and life. Perspectives from Psychology Biology 8 Evolution. R. Plutchik. 2002. Emotions and life. Perspectives from Psychology Biology 8 Evolution.
[25]
S. Wang and X. Meng . 2018. Multi-emotion category improving embedding for sentiment classification . In Proceedings of the Conference on Information and Knowledge Management. 1719--1722 . S. Wang and X. Meng. 2018. Multi-emotion category improving embedding for sentiment classification. In Proceedings of the Conference on Information and Knowledge Management. 1719--1722.
[26]
J. Pennington , R. Socher , and C. D. Manning . 2014. GloVe: Global vectors forword representation . In Proceedings of the Empirical Methods of Natural Language Processing. 1532--1543 . J. Pennington, R. Socher, and C. D. Manning. 2014. GloVe: Global vectors forword representation. In Proceedings of the Empirical Methods of Natural Language Processing. 1532--1543.
[27]
WordNet

George A. Miller

Communications of the ACM 10.1145/219717.219748
[28]
C. F. Baker , C. J. Fillmore , and J. B. Lowe . 1998. The Berkeley framenet project . In Proceedings of the Association for Computational Linguistics. 86--90 . C. F. Baker, C. J. Fillmore, and J. B. Lowe. 1998. The Berkeley framenet project. In Proceedings of the Association for Computational Linguistics. 86--90.
[29]
J. Ganitkevitch , B. Van Durme , and C. Callison-Burch . 2013. PPDB: The paraphrase database . In Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics. 758--764 . J. Ganitkevitch, B. Van Durme, and C. Callison-Burch. 2013. PPDB: The paraphrase database. In Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics. 758--764.
[31]
Yequan Wang Minlie Huang Xiaoyan Zhu and Li Zhao. 2016. Attention-based LSTM for aspect-level sentiment classification. In Empirical Methods Natural Language Processing. 606--615 Yequan Wang Minlie Huang Xiaoyan Zhu and Li Zhao. 2016. Attention-based LSTM for aspect-level sentiment classification. In Empirical Methods Natural Language Processing. 606--615 10.18653/v1/d16-1058
[34]
M. B. Arnold . 1950 . An excitatory theory of emotion . In Feelings and Emotions: The Mooseheart Symposium, M. L. Reymert (Ed.). McGraw-Hill, 11--33 . M. B. Arnold. 1950. An excitatory theory of emotion. In Feelings and Emotions: The Mooseheart Symposium, M. L. Reymert (Ed.). McGraw-Hill, 11--33.
[35]
An argument for basic emotions

Paul Ekman

Cognition and Emotion 10.1080/02699939208411068
[36]
C. E. Izard . 1991. The Psychology of Emotions . Plenum , New York . C. E. Izard. 1991. The Psychology of Emotions. Plenum, New York.
[37]
W. MacDougall . 1921. An Introduction to Social Psychology. John W . Luce , Boston, MA . W. MacDougall. 1921. An Introduction to Social Psychology. John W. Luce, Boston, MA.
Metrics
14
Citations
38
References
Details
Published
Apr 17, 2020
Vol/Issue
20(2)
Pages
1-17
License
View
Funding
Fundamental Research Funds for the Central Universities Award: 11XNL010
Natural Science Foundation of China Award: 91846204, 91646203, 61532016, 61532010, 61762082
National Key Research and Development Program of China Award: 2016YFB1000602, 2016YFB1000603
the Science and Technology Opening up Cooperation project of Henan Province Award: 172106000077
Cite This Article
Shuo Wang, Aishan Maoliniyazi, Xinle Wu, et al. (2020). Emo2Vec. ACM Transactions on Internet Technology, 20(2), 1-17. https://doi.org/10.1145/3372152
Related

You May Also Like

Toward trustworthy recommender systems

Bamshad Mobasher, Robin Burke · 2007

359 citations

Collaborative recommendation

Michael O'Mahony, Neil Hurley · 2004

237 citations