Targeted Sentiment Classification Based on Attentional Encoding and Graph Convolutional Networks
Source abstract
Abstract
Targeted sentiment classification aims to predict the emotional trend of a specific goal. Currently, most methods (e.g., recurrent neural networks and convolutional neural networks combined with an attention mechanism) are not able to fully capture the semantic information of the context and they also lack a mechanism to explain the relevant syntactical constraints and long-range word dependencies. Therefore, syntactically irrelevant context words may mistakenly be recognized as clues to predict the target sentiment. To tackle these problems, this paper considers that the semantic information, syntactic information, and their interaction information are very crucial to targeted sentiment analysis, and propose an attentional-encoding-based graph convolutional network (AEGCN) model. Our proposed model is mainly composed of multi-head attention and an improved graph convolutional network built over the dependency tree of a sentence. Pre-trained BERT is applied to this task, and new state-of-art performance is achieved. Experiments on five datasets show the effectiveness of the model proposed in this paper compared with a series of the latest models.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Sentiment Analysis and Opinion Mining · Mental Health via Writing · Advanced Text Analysis Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Physics and Telecommunication Engineering, Guangdong Provincial Key Laboratory of Quantum Engineering and Quantum Materials, South China Normal University, Guangzhou 510006, China
School of Computing, Informatics, and Decision Systems Engineering, Arizona State University, Tempe, AZ 85287, USA
Guangdong China Construction Pulian Technology Co., Ltd, Guangzhou 510000, China
References (40)
Show source-provided references
1. Chen, Y. (2018). Service-Oriented Computing and System Integration: Software, IoT, Big Data, and AI as Services, Kendall Hunt Publishing. [6th ed.].
2. Opinion mining and sentiment analysis
3. Sentiment analysis and opinion mining
4. Jiang, L., Yu, M., Zhou, M., Liu, X., and Zhao, T. (2011, January 19–24). Target-dependent twitter sentiment classification. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, Portland, OR, USA.
5. Wagner, J., Arora, P., Cortes, S., Barman, U., Bogdanova, D., Foster, J., and Tounsi, L. (2014, January 23–24). Dcu: Aspect-based polarity classification for semeval task 4. Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), Dublin, Ireland.10.3115/v1/S14-2036 ↗
6. Tang, D., Qin, B., and Liu, T. (2016). Aspect level sentiment classification with deep memory network. arXiv.10.18653/v1/D16-1021 ↗
7. Wang, Y., Huang, M., Zhao, L., and Zhu, X. (2016, January 1–5). Attention-based lstm for aspect-level sentiment classification. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.10.18653/v1/D16-1058 ↗
8. Tang, D., Qin, B., Feng, X., and Liu, T. (2016). Effective lstms for target-dependent sentiment classification. arXiv.
9. Xue, W., and Li, T. (2018). Aspect based sentiment analysis with gated convolutional networks. arXiv.10.18653/v1/P18-1234 ↗
10. Ma, D., Li, S., Zhang, X., and Wang, H. (2017). Interactive attention networks for aspect-level sentiment classification. arXiv.10.24963/ijcai.2017/568 ↗
11. Chen, P., Sun, Z., Bing, L., and Yang, W. (2017, January 7–11). Recurrent attention network on memory for aspect sentiment analysis. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Copenhagen, Denmark.10.18653/v1/D17-1047 ↗
12. Li, X., Bing, L., Lam, W., and Shi, B. (2018). Transformation networks for target-oriented sentiment classification. arXiv.10.18653/v1/P18-1087 ↗
13. Li, X., Song, J., Gao, L., Liu, X., Huang, W., He, X., and Gan, C. (February, January 27). Beyond RNNs: Positional Self-Attention with Co-Attention for Video Question Answering. Proceedings of the 33rd AAAI Conference on Artificial Intelligence, Honolulu, HI, USA. No 01.10.1609/aaai.v33i01.33018658 ↗
14. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, Neural Information Processing Systems Foundation, Inc.
15. Zhang, C., Li, Q., and Song, D. (2019). Aspect-based Sentiment Classification with Aspect-specific Graph Convolutional Networks. arXiv.10.18653/v1/D19-1464 ↗
16. Huang, B., and Carley, K.M. (2019). Syntax-Aware Aspect Level Sentiment Classification with Graph Attention Networks. arXiv.10.18653/v1/D19-1549 ↗
17. Kipf, T.N., and Welling, M. (2017). Semi-supervised classification with graph convolutional networks. arXiv.
18. Kim, Y. (2014). Convolutional neural networks for sentence classification. arXiv.10.3115/v1/D14-1181 ↗
19. Rao, D., and Ravichandran, D. (April, January 30). Semi-supervised polarity lexicon induction. Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics, Athens, Greece.
20. Ding, X., Liu, B., and Yu, P.S. (2008, January 11–12). A holistic lexicon-based approach to opinion mining. Proceedings of the 2008 International Conference on Web Search and Data Mining, Palo Alto, CA, USA.10.1145/1341531.1341561 ↗
21. Modeling multi-aspects within one opinionated sentence simultaneously for aspect-level sentiment analysis10.1016/j.future.2018.10.041 ↗
22. Song, Y., Wang, J., Jiang, T., Liu, Z., and Rao, Y. (2019). Attentional encoder network for targeted sentiment classification. arXiv.10.1007/978-3-030-30490-4_9 ↗
23. Li, Z., Wei, Y., and Zhang, Y. (February, January 27). Exploiting coarse-to-fine task transfer for aspect-level sentiment classification. Proceedings of the 33rd AAAI Conference on Artificial Intelligence, Honolulu, HI, USA.10.1609/aaai.v33i01.33014253 ↗
24. Bruna, J., Zaremba, W., Szlam, A., and LeCun, Y. (2014). Spectral networks and locally connected networks on graphs. arXiv.
25. Henaff, M., Bruna, J., and LeCun, Y. (2015). Deep convolutional networks on graph-structured data. arXiv.
26. Defferrard, M., Bresson, X., and Vandergheynst, P. (2016, January 5–10). Convolutional neural networks on graphs with fast localized spectral filtering. Proceedings of the Advances in Neural Information Processing Systems 29, Barcelona, Spain.
27. Qi, X., Liao, R., Jia, J., Fidler, S., and Urtasun, R. (2017, January 22–29). 3d graph neural networks for RGBD semantic segmentation. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.556 ↗
28. Marcheggiani, D., and Titov, I. (2017). Encoding sentences with graph convolutional networks for semantic role labeling. arXiv.10.18653/v1/D17-1159 ↗
29. Classifying relations in clinical narratives using segment graph convolutional and recurrent neural networks (seg-gcrns)10.1093/jamia/ocy157 ↗
30. Peng, H., Li, J., He, Y., Liu, Y., Bao, M., Wang, L., Song, Y., and Yang, Q. (2018, January 23–27). Large-scale hierarchical text classification with recursively regularized deep graph-cnn. Proceedings of the 2018 World Wide Web Conference on World Wide Web, Lyon, France.10.1145/3178876.3186005 ↗
31. Hou, X., Huang, J., Wang, G., Huang, K., He, X., and Zhou, B. (2019). Selective Attention Based Graph Convolutional Networks for Aspect-Level Sentiment Classification. arXiv.
32. Zhao, P., Hou, L., and Wu, O. (2019). Modeling Sentiment Dependencies with Graph Convolutional Networks for Aspect-level Sentiment Classification. arXiv.10.1016/j.knosys.2019.105443 ↗
33. Pennington, J., Socher, R., and Manning, C. (2014, January 25–29). Glove: Global vectors for word representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.10.3115/v1/D14-1162 ↗
34. Devlin, J., Chang, M., Lee, K., and Toutanova, K. (2019, January 2–7). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: NAACL-HLT 2019, Minneapolis, MN, USA. (Long and Short Papers).
35. Dong, L., Wei, F., Tan, C., Tang, D., Zhou, M., and Xu, K. (2014, January 23–25). Adaptive recursive neural network for target-dependent twitter sentiment classification. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Baltimore, MD, USA.10.3115/v1/P14-2009 ↗
36. Maria Pontiki, D.G., John Pavlopoulos, H.P., and Ion Androutsopoulos, S.M. (2014, January 23–24). Semeval-2014 task 4: SemEval-2014 Task 4: Aspect Based Sentiment Analysis. Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), Dublin, Ireland.10.3115/v1/S14-2004 ↗
37. Pontiki, M., Galanis, D., Papageorgiou, H., Manandhar, S., and Androutsopoulos, I. (2015, January 4–5). Semeval-2015 task 12: Aspect based sentiment analysis. Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), Denver, Colorado.10.18653/v1/S15-2082 ↗
38. Pontiki, M., Galanis, D., Papageorgiou, H., Androutsopoulos, I., Manandhar, S., Al-Smadi, M., Al-Ayyoub, M., Zhao, Y., Qin, B., and de Clercq, O. (2016, January 16–17). Semeval-2016 task 5: Aspect based sentiment analysis. Proceedings of the 10th international Workshop on Semantic Evaluation (SemEval-2016), San Diego, CA, USA.10.18653/v1/S16-1002 ↗
39. Kiritchenko, S., Zhu, X., Cherry, C., and Mohammad, S. (2014, January 23–24). Nrc-canada-2014: Detecting aspects and sentiment in customer reviews. Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), Dublin, Ireland.10.3115/v1/S14-2076 ↗
40. Huang, B., Ou, Y., and Carley, K.M. (2018). Aspect level sentiment classification with attention-over-attention neural networks. arXiv.10.1007/978-3-319-93372-6_22 ↗