journal article·2021-11-05Open access

A Knowledge Graph-Enhanced Attention Aggregation Network for Making Recommendations

Dehai Zhang, Xiaobo Yang, Linan Liu, Qing Liu

Applied Sciences· Volume 11· Issue 21

Abstract

In recent years, many researchers have devoted time to designing algorithms used to introduce external information from knowledge graphs, to solve the problems of data sparseness and the cold start, and thus improve the performance of recommendation systems. Inspired by these studies, we proposed KANR, a knowledge graph-enhanced attention aggregation network for making recommendations. This is an end-to-end deep learning model using knowledge graph embedding to enhance the attention aggregation network for making recommendations. It consists of three main parts. The first is the attention aggregation network, which collect the user’s interaction history and captures the user’s preference for each item. The second is the knowledge graph-embedded model, which aims to integrate the knowledge. The semantic information of the nodes and edges in the graph is mapped to the low-dimensional vector space. The final part is the information interaction unit, which is used for fusing the features of two vectors. Experiments showed that our model achieved a stable improvement compared to the baseline model in making recommendations for movies, books, and music.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Recommender Systems and Techniques · Advanced Graph Neural Networks · Topic Modeling

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Software, Yunnan University, Kunming 650504, China

Funding

Open Foundation of Key Laboratory in Software Engineering of Yunnan Province · Natural Science Foundation China

References (31)

Show source-provided references
1. Rendle, S., Krichene, W., Zhang, L., and Anderson, J. (2020, January 22–26). Neural collaborative filtering vs. matrix factorization revisited. Proceedings of the Fourteenth ACM Conference on Recommender Systems, Virtual Event, Brazil.10.1145/3383313.3412488 ↗
2. Song, W., Xiao, Z., Wang, Y., Charlin, L., Zhang, M., and Tang, J. (2019, January 11–15). Session-based social recommendation via dynamic graph attention networks. Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, Melbourne VIC, Australia.10.1145/3289600.3290989 ↗
3. Wang, H., Zhang, F., Hou, M., Xie, X., Guo, M., and Liu, Q. (2018, January 5–9). Shine: Signed heterogeneous information network embedding for sentiment link prediction. Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, Marina Del Rey, CA, USA.10.1145/3159652.3159666 ↗
4. Hybrid collaborative recommendation of co-embedded item attributes and graph features10.1016/j.neucom.2021.01.129 ↗
5. Wang, H., Zhang, F., Wang, J., Zhao, M., Li, W., Xie, X., and Guo, M. (2018, January 22–26). RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systems. Proceedings of the 27th ACM International Conference on Information and Knowledge Management, Torino, Italy.10.1145/3269206.3271739 ↗
6. DBpedia—A crystallization point for the Web of Data10.1016/j.websem.2009.07.002 ↗
7. Pelikánová, Z. (2021, October 27). Google Knowledge Graph. (In Czech).
8. Das, D., Sahoo, L., and Datta, S. (2017). A survey on recommendation system. Int. J. Comput. Appl., 160, Available online: https://www.ijcaonline.org/archives/volume160/number7/das-2017-ijca-913081.pdf.10.5120/ijca2017913081 ↗
9. Knowledge graph embedding: A survey of approaches and applications10.1109/TKDE.2017.2754499 ↗
10. Wang, H., Zhang, F., Zhao, M., Li, W., Xie, X., and Guo, M. (2019, January 13). Multi-task feature learning for knowledge graph enhanced recommendation. Proceedings of the World Wide Web Conference, San Francisco, CA, USA.10.1145/3308558.3313411 ↗
11. Zhang, Y., and Yang, Q. (2017). A survey on multi-task learning. arXiv.10.1093/nsr/nwx105 ↗
12. Wang, H., Zhang, F., Xie, X., and Guo, M. (2018, January 10). DKN: Deep Knowledge-Aware Network for News Recommendation. Proceedings of the 2018 World Wide Web Conference on World Wide Web, International World Wide Web Conferences Steering Committee, Lyon, France.10.1145/3178876.3186175 ↗
13. Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
14. Zhang, F., Yuan, N.J., Lian, D., Xie, X., and Ma, W.Y. (2016, January 13). Collaborative knowledge base embedding for recommender systems. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939673 ↗
15. Wang, X., Wang, D., Xu, C., He, X., Cao, Y., and Chua, T.S. (February, January 27). Explainable reasoning over knowledge graphs for recommendation. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA.
16. LSTM: A search space odyssey10.1109/TNNLS.2016.2582924 ↗
17. Lei, D., Jiang, G., Gu, X., Sun, K., Mao, Y., and Ren, X. (2020). Learning Collaborative Agents with Rule Guidance for Knowledge Graph Reasoning. arXiv.10.18653/v1/2020.emnlp-main.688 ↗
18. Deep reinforcement learning: A brief survey10.1109/MSP.2017.2743240 ↗
19. Wang, H., Zhao, M., Xie, X., Li, W., and Guo, M. (2019, January 13). Knowledge graph convolutional networks for recommender systems. Proceedings of the World Wide Web Conference, San Francisco, CA, USA.10.1145/3308558.3313417 ↗
20. Zhang, D., Liu, L., Wei, Q., Yang, Y., Yang, P., and Liu, Q. (2020). Neighborhood Aggregation Collaborative Filtering Based on Knowledge Graph. Appl. Sci., 10.10.3390/app10113818 ↗
21. Kipf, T.N., and Welling, M. (2016). Semi-supervised classification with graph convolutional networks. arXiv.
22. Lin, Y., Liu, Z., Sun, M., Liu, Y., and Zhu, X. (2015, January 19). Learning entity and relation embeddings for knowledge graph completion. Proceedings of the AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v29i1.9491 ↗
23. Ji, G., He, S., Xu, L., Liu, K., and Zhao, J. (2015, January 26–31). Knowledge graph embedding via dynamic mapping matrix. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, China. Available online: https://aclanthology.org/P15-1067.pdf.10.3115/v1/P15-1067 ↗
24. Liu, H., Wu, Y., and Yang, Y. (2017, January 6–11). Analogical Inference for MultiRelational Embeddings. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia. Available online: http://proceedings.mlr.press/v70/liu17d/liu17d.pdf.
25. Nickel, M., Rosasco, L., and Poggio, T. (2016, January 7). Holographic Embeddings of Knowledge Graphs. Proceedings of the 30th AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v30i1.10314 ↗
26. Huang, P.S., He, X., Gao, J., Deng, L., Acero, A., and Heck, L. (2013, January 27). Learning deep structured semantic models for web search using clickthrough data. Proceedings of the 22nd ACM international conference on Information & Knowledge Management, San Francisco, CA, USA.10.1145/2505515.2505665 ↗
27. Yang, B., Yih, W.-T., He, X., Gao, J., and Deng, L. (2015, January 7–9). Embedding entities and relations for learning and inference in knowledge bases. Proceedings of the International Conference on Learning Representations, San Diego, CA, USA.
28. Wang, R., Fu, B., Fu, G., and Wang, M. (2017, January 14). Deep & Cross Network for Ad Click Predictions. Proceedings of the ADKDD’17, Halifax, NS, Canada.10.1145/3124749.3124754 ↗
29. Cheng, H.T., Koc, L., Harmsen, J., Shaked, T., Chandra, T., Aradhye, H., Anderson, G., Corrado, G., Chai, W., and Ispir, M. (2016, January 15). Wide & deep learning for recommender systems. Proceedings of the 1st Workshop on Deep Learning for Recommender Systems, Boston, MA, USA.10.1145/2988450.2988454 ↗
30. Factorization machines with libfm
31. Su, Y., Zhang, R., Erfani, S., and Gan, J. (2021). Neural Graph Matching based Collaborative Filtering. arXiv.10.1145/3404835.3462833 ↗