Sparse Online Learning for Collaborative Filtering
Keywords:
Recommender systems, Collaborative Filtering, Online learning, SOCFI, SOCFIIAbstract
With the rapid growth of Internet information, our individual processing capacity has become over-whelming. Thus, we really need recommender systems to provide us with items online in real time. In reality, a user’s interest and an item’s popularity are always changing over time. Therefore, recommendation approaches should take such changes into consideration. In this paper, we propose two approaches, i.e., First Order Sparse Collaborative Filtering (SOCFI) and Second Order Sparse Online Collaborative Filtering (SOCFII), to deal with the user-item ratings for online collaborative filtering. We conduct some experiments on such real data sets as Movie- Lens100K and MovieLens1M, to evaluate our proposed methods. The results show that, our proposed approach is able to effectively online update the recommendation model from a sequence of rating observation. And in terms of RMSE, our proposed approach outperforms other baseline methods.
References
G. Linden, B. Smith, and J. York (2003), Amazon. com recommendations: Item-to-item collaborative filtering, Internet Comput. IEEE, 7(1): 76-80. http://dx.doi.org/10.1109/MIC.2003.1167344
M. D. Ekstrand, R. Join T., and K. Joseph A.(2011), Collaborative Filtering Recommender Systems, Found. Trends® Human-Computer Interact., 4(2): 81-173. http://dx.doi.org/10.1561/1100000009
Z. Wang and H. Lu (2014), Online Recommender System Based on Social Network Regularization, Neural Inf. Process., 487-494, Nov. 2014.
J. B. Schafer, J. Konstan, and J. Riedl (1999), Recommender systems in e-commerce, Electronic Commerce, 158-166.
K. Dohyun and Y. Bong Jin (2005), Collaborative filtering based on iterative principal component analysis, Expert Syst. Appl., 28(4): 823-830. http://dx.doi.org/10.1016/j.eswa.2004.12.037
J. L. Herlocker, J. A. Konstan, L. G. Terveen, and J. T. Riedl (2004), Evaluating collaborative filtering recommender systems, ACM Trans. Inf. Syst. TOIS, 22(1): 5-53, 2004. http://dx.doi.org/10.1145/963770.963772
B. Sarwar, G. Karypis, J. Konstan, and J. Reidl (2001), Item-based collaborative filtering recommendation algorithms, Proceedings of the 10th international conference on World Wide Web, 285-295. http://dx.doi.org/10.1145/371920.372071
J. A. Konstan, B. N. Miller, D. Maltz, J. L. Herlocker, L. R. Gordon, and J. Riedl (1997), GroupLens: applying collaborative filtering to Usenet news, Commun. ACM, 40(3): 77-87. http://dx.doi.org/10.1145/245108.245126
J. Wang, S. C. H. Hoi, P. Zhao, and Z.-Y. Liu (2013), Online multi-task collaborative filtering for on-the-fly recommender systems, Proceedings of the 7th ACM conference on Recommender systems, 2013, 237-244. http://dx.doi.org/10.1145/2507157.2507176
K. Yehuda and I. Haifa (2010), Collaborative filtering with temporal dynamics, Commun. ACM, 53(4): 89-97. http://dx.doi.org/10.1145/1721654.1721677
J. Z. Kolter and M. Maloof (2003), Dynamic weighted majority: a new ensemble method for tracking concept drift, ICDM 2003. Third IEEE International Conference on, 123-130. http://dx.doi.org/10.1109/ICDM.2003.1250911
D. Wang, P. Wu, P. Zhao, Y. Wu, C. Miao, and S. C. H. Hoi (2014), High-Dimensional Data Stream Classification via Sparse Online Learning, Data Mining (ICDM), 2014 IEEE International Conference on, 1007-1012.
J. Abernethy, K. Canini, J. Langford, and A. Simma (2007), Online collaborative filtering, Univ. Calif. Berkeley Tech Rep, 2007.
M. Ali, C. C. Campbell, and A. K. Tang (2011), Parallel Collaborative Filtering for Streaming Data, http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.230.8613.
J. Wilson, S. Chaudhury, B. Lall, and P. Kapadia (2014), Improving Collaborative Filtering based Recommenders using Topic Modelling, Web Intelligence, 340-346.
T. Hofmann (2004), Latent semantic models for collaborative filtering, ACM Trans. Inf. Syst., v 22(1): 89-115. http://dx.doi.org/10.1145/963770.963774
R. Salakhutdinov, A. Mnih, and G. Hinton (2007), Restricted Boltzmann machines for collaborative filtering, Proceedings of the 24th international conference on Machine learning, 791-798. http://dx.doi.org/10.1145/1273496.1273596
Li M; Wu C; Zhang L; You LN (2015), An Intuitionistic Fuzzy-Todim Method To Solve Distributor Evaluation And Selection Problem, International Journal Of Simulation Modelling, 14(3): 511-524. http://dx.doi.org/10.2507/IJSIMM14(3)CO12
A. Mnih and R. Salakhutdinov (2007), Probabilistic matrix factorization, Advances in neural information processing systems, 1257-1264.
G. Rainer, N. Nrik, H. Peter J., and S. Yannis (2011), Large-scale matrix factorization with distributed stochastic gradient descent, Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining, 69-77.
Saric T; Simunovic G; Simunovic K (2013), Use Of Neural Networks In Prediction And Simulation Of Steel Surface Roughness, International Journal Of Simulation Modelling, 12(4): 225-236. http://dx.doi.org/10.2507/IJSIMM12(4)2.241
R. M. Bell, Y. Koren, and C. Volinsky (2007), The BellKor solution to the Netflix Prize, http://www.netflixprize.com/assets/ProgressPrize2007_KorBell.pdf, 1-15.
J. Bennett and S. Lanning (2007), The Netflix Prize, KDD Cup Workshop Conjunction KDD, 2007.
Z. Qiao, P. Zhang, J. He, Y. Cao, C. Zhou, and L. Guo (2014), Combining geographical information of users and content of items for accurate rating prediction, Proceedings of the companion publication of the 23rd international conference on World wide web companion, 361-362.
W. Li and D. Yeung (2011), Social Relations Model for Collaborative Filtering, Twenty-Fifth AAAI Conference on Artificial Intelligence, 803-808.
Ocevcic Hrvoje; Nenadic Kresimir; Solic Kresimir (2014), Decision Support Based On The Risk Assessment Of Information Systems And Bayesian Learning, Tehnicki Vjesnik- Technical Gazette, 21(3): 539-544.
Y. Koren, R. Bell, and C. Volinsky (2009), Matrix factorization techniques for recommender systems, Computer, 8: 30-37. http://dx.doi.org/10.1109/MC.2009.263
M. Julien, B. Francis, P. Jean, and S. Guillermo (2010), Online Learning for Matrix Factorization and Sparse Coding, J. Mach. Learn. Res., 11: 19-60.
S. Shalev-Shwartz (2011), Online Learning and Online Convex Optimization, Found. Trends Mach. Learn., 4(2): 107-194. http://dx.doi.org/10.1561/2200000018
R. Pálovics, A. A. Benczúr, L. Kocsis, T. Kiss, and E. Frigó (2014), Exploiting temporal influence in online recommendation, 273-280.
G. Ling, H. Yang, I. King, and M. R. Lyu (2012), Online Learning for Collaborative Filtering, IEEE World Congress on Computational Intelligence, Brisbane, Australia, 1 - 8.
Published
Issue
Section
License
ONLINE OPEN ACCES: Acces to full text of each article and each issue are allowed for free in respect of Attribution-NonCommercial 4.0 International (CC BY-NC 4.0.
You are free to:
-Share: copy and redistribute the material in any medium or format;
-Adapt: remix, transform, and build upon the material.
The licensor cannot revoke these freedoms as long as you follow the license terms.
DISCLAIMER: The author(s) of each article appearing in International Journal of Computers Communications & Control is/are solely responsible for the content thereof; the publication of an article shall not constitute or be deemed to constitute any representation by the Editors or Agora University Press that the data presented therein are original, correct or sufficient to support the conclusions reached or that the experiment design or methodology is adequate.
