journal article·2022-04-22Open access

Logit Averaging: Capturing Global Relation for Session-Based Recommendation

Heeyoon Yang, Gahyung Kim, Jee-Hyoung Lee

Applied Sciences· Volume 12· Issue 9

Abstract

Session-based recommendation predicts an anonymous user’s next action, whether she or he is likely to purchase based on the user’s behavior in the current session as sequences. Most recent research on session-based recommendations makes predictions based on a single-session without incorporating global relationships between sessions. It does not guarantee a better performance because item embeddings learned by solely utilizing a single session (inter-session) have less item transition information than utilizing both intra- and inter-session ones. Some existing methods tried to enhance recommendation performance by adopting memory modules and global transition graphs; however, those need more computation cost and time. We propose a novel algorithm called Logit Averaging (LA), utilizing both (i) local-level logits, which come from intra-sessions item transitions and (ii) global-level logits, which come from gathered logits of related sessions. The proposed method shows an improvement in recommendation performance in respect of accuracy and diversity through extensive experiments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Recommender Systems and Techniques · Advanced Bandit Algorithms Research · Stochastic Gradient Optimization Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Artificial Intelligent, SungKyunKwan University, Suwon 16419, Korea

Funding

MSIT(Ministry of Science and ICT) · Sungkyunkwan University

References (37)

Show source-provided references
1. Zhang, S., Yao, L., Sun, A., and Tay, Y. (2019). Deep learning based recommender system: A survey and new perspectives. arXiv.10.1145/3285029 ↗
2. Covington, P., Adams, J., and Sargin, E. (2016, January 15–19). Deep neural networks for youtube recommendations. Proceedings of the 10th ACM Conference on Recommender Systems, Boston, MA, USA.10.1145/2959100.2959190 ↗
3. Sarwar, B., Karypis, G., Konstan, J., and Riedl, J. (2001, January 1–5). Item-Based Collaborative Filtering Recommendation Algorithms. Proceedings of the 10th International Conference on World Wide Web, Hong Kong, China.10.1145/371920.372071 ↗
4. Rendle, S., Freudenthaler, C., and Schmidt-Thieme, L. (2010, January 26–30). Factorizing Personalized Markov Chains for Next-Basket Recommendation. Proceedings of the 19th International Conference on World Wide Web, Raleigh, NC, USA.10.1145/1772690.1772773 ↗
5. He, X., Liao, L., Zhang, H., Nie, L., Hu, X., and Chua, T. (2017, January 3–7). Neural Collaborative Filtering. Proceedings of the 26th International Conference on World Wide Web, Perth, Australia.10.1145/3038912.3052569 ↗
6. Chen, Y., and de Rijke, M. (2018, January 6). A collective variational autoencoder for top-n recommendation with side information. Proceedings of the 3rd Workshop on Deep Learning for Recommender Systems, Vancouver, BC, Canada.10.1145/3270323.3270326 ↗
7. Dong, X., Yu, L., Wu, Z., Sun, Y., Yuan, L., and Zhang, F. (2017, January 4–9). A hybrid collaborative filtering model with deep structure for recommender systems. Proceedings of the AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v31i1.10747 ↗
8. Liu, F., Cheng, Z., Zhu, L., Gao, Z., and Nie, L. (2021, January 19–23). Interest-aware message-passing gcn for recommendation. Proceedings of the Web Conference 2021, Ljubljana, Solvenia.10.1145/3442381.3449986 ↗
9. Choi, M., Kim, J., Lee, J., Shim, H., and Lee, J. (2021, January 19–23). Session-Aware Linear Item-Item Models for Session-Based Recommendation. Proceedings of the Web Conference 2021, Ljubljana, Slovenia.10.1145/3442381.3450005 ↗
10. Wang, S., Cao, L., Wang, Y., Sheng, Q.Z., Orgun, M.A., and Lian, D. (2021). A Survey on Session-Based Recommender Systems. arXiv.10.1145/3465401 ↗
11. Li, J., Ren, P., Chen, Z., Ren, Z., Lian, T., and Ma, J. (2017, January 6–10). Neural attentive session-based recommendation. Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, Singapore.10.1145/3132847.3132926 ↗
12. Fang, J. (2021). Session-based Recommendation with Self-Attention Networks. arXiv.10.1137/1.9781611976700.10 ↗
13. Cho, K., Merrienboer, V.B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014, January 25–29). Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, Doha, Qatar.10.3115/v1/D14-1179 ↗
14. Kipf, T.N., and Welling, M. (2017, January 24–26). Semi-Supervised Classification with Graph Convolutional Networks. Proceedings of the 5th International Conference on Learning Representations, Toulon, France.
15. Wu, S., Tang, Y., Zhu, Y., Wang, L., Xie, X., and Tan, T. (February, January 27). Session-based recommendation with graph neural networks. Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, Honolulu, HI, USA.
16. Gupta, P., Garg, D., Malhotra, P., Vig, L., and Shroff, G. (2019, January 3–7). NISER: Normalized item and session representations to handle popularity bias. Proceedings of the 1st International Workshop on Graph Representation Learning on Its Applications (CIKM ’19), Beijing, China.
17. Chen, T., and Wong, R.C.W. (2020, January 23–27). Handling information loss of graph neural networks for session-based recommendation. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Virtual Event.10.1145/3394486.3403170 ↗
18. Mitheran, S., Java, A., Sahu, S.K., and Shaikh, A. (2022). Introducing Self-Attention to Target Attentive Graph Neural Networks. arXiv.
19. Li, A., Cheng, Z., Liu, F., Gao, Z., Guan, W., and Peng, Y. (2022). Disentangled Graph Neural Networks for Session-based Recommendation. arXiv.10.2139/ssrn.4087652 ↗
20. Li, Y., Tarlow, D., Brockschmidt, M., and Zemel, R.S. (2016, January 2–4). Gated Graph Sequence Neural Networks. Proceedings of the 4th International Conference on Learning Representations, San Juan, Puerto Rico.
21. Wang, M., Ren, P., Mei, L., Chen, Z., Ma, J., and de Rijke, M. (2019, January 21–25). A Collaborative Session-Based Recommendation Approach with Parallel Memory Modules. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, Paris, France.10.1145/3331184.3331210 ↗
22. Wang, Z., Wei, W., Cong, G., Li, X.L., Mao, X.L., and Qiu, M. (2020, January 25–30). Global context enhanced graph neural networks for session-based recommendation. Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event.10.1145/3397271.3401142 ↗
23. Mi, F., and Faltings, B. (2020, January 7–15). Memory Augmented Neural Model for Incremental Session-Based Recommendation. Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, Yokohama, Japan.10.24963/ijcai.2020/300 ↗
24. Zhou, H., Tan, Q., Huang, X., Zhou, K., and Wang, X. (2021, January 11–15). Temporal Augmented Graph Neural Networks for Session-Based Recommendations. Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event.10.1145/3404835.3463112 ↗
25. Huang, C., Xia, X., Dai, C., and Bo, Z. (2021, January 2–9). Graph-Enhanced Multi-Task Learning of Multi-Level Transition Dynamics for Session-based Recommendation. Proceedings of the 35th AAAI Conference on Artificial Intelligence, Virtual Event.10.1609/aaai.v35i5.16534 ↗
26. Self-Supervised Graph Co-Training for Session-based Recommendation
27. Pang, Y., Wu, L., Shen, Q., Zhang, Y., Wei, Z., Xu, F., Chang, E., Long, B., and Pei, J. (2022, January 21–25). Heterogeneous global graph neural networks for personalized session-based recommendation. Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining, Virtual Event.10.1145/3488560.3498505 ↗
28. Menon, A., Jayasumana, S., Rawat, A., Jain, H., Veit, A., and Kumar, S. (2021, January 3–7). Long-tail learning via logit adjustment. Proceedings of the 2021 International Conference on Learning Representation, Virtual Conference.
29. Novelty and Diversity in Top-N Recommendation—Analysis and Evaluation10.1145/1944339.1944341 ↗
30. Bradley, K., and Smyth, B. (2001, January 1). Improving recommendation diversity. Proceedings of the Twelfth Irish Conference on Artificial Intelligence and Cognitive Science, Maynooth, Ireland.
31. Miyamoto, S., Zamami, T., and Yamana, H. (2019, January 15–18). Appearance frequency-based ranking method for improving recommendation diversity. Proceedings of the 2019 IEEE 4th International Conference on Big Data Analytics (ICBDA), Suzhou, China.10.1109/ICBDA.2019.8713185 ↗
32. Diversified and scalable service recommendation with accuracy guarantee10.1109/TCSS.2020.3007812 ↗
33. Anderson, C. (2006). The Long Tail: Why the Future of Business is Selling Less of More, Hachette Books.
34. Park, Y.J., and Tuzhilin, A. (2008, January 23–25). The long tail of recommender systems and how to leverage it. Proceedings of the 2008 ACM Conference on Recommender Systems, Lausanne, Switzerland.10.1145/1454008.1454012 ↗
35. Accuracy-diversity trade-off in recommender systems via graph convolutions10.1016/j.ipm.2020.102459 ↗
36. Wang, Y., Wang, W., Liang, Y., Cai, Y., and Hooi, B. (2021, January 12–16). Mixup for Node and Graph Classification. Proceedings of the Web Conference 2021, Ljubljana, Slovenia.10.1145/3442381.3449796 ↗
37. Kong, K., Li, G., Ding, M., Wu, Z., Zhu, C., Ghanem, B., Taylor, G., and Goldstein, T. (2020). Flag: Adversarial data augmentation for graph neural networks. arXiv.