Sparse Online Learning for Collaborative Filtering

  • Fan Lin Xiamen University
  • Xiuze Zhou Department of Automation, Xiamen University China, General Office at Haiyun Campus, Xiamen University, Xiamen, 361009
  • Wenhua Zeng Software School, Xiamen University China, 502 of General Office at Haiyun Campus, Xiamen University, Xiamen, 361009


With the rapid growth of Internet information, our individual processing capacity has become over-whelming. Thus, we really need recommender systems to provide us with items online in real time. In reality, a user’s interest and an item’s popularity are always changing over time. Therefore, recommendation approaches should take such changes into consideration. In this paper, we propose two approaches, i.e., First Order Sparse Collaborative Filtering (SOCFI) and Second Order Sparse Online Collaborative Filtering (SOCFII), to deal with the user-item ratings for online collaborative filtering. We conduct some experiments on such real data sets as Movie- Lens100K and MovieLens1M, to evaluate our proposed methods. The results show that, our proposed approach is able to effectively online update the recommendation model from a sequence of rating observation. And in terms of RMSE, our proposed approach outperforms other baseline methods.


[1] G. Linden, B. Smith, and J. York (2003), Amazon. com recommendations: Item-to-item collaborative filtering, Internet Comput. IEEE, 7(1): 76–80.

[2] M. D. Ekstrand, R. Join T., and K. Joseph A.(2011), Collaborative Filtering Recommender Systems, Found. Trends® Human–Computer Interact., 4(2): 81–173.

[3] Z. Wang and H. Lu (2014), Online Recommender System Based on Social Network Regularization, Neural Inf. Process., 487–494, Nov. 2014.

[4] J. B. Schafer, J. Konstan, and J. Riedl (1999), Recommender systems in e-commerce, Electronic Commerce, 158–166.

[5] K. Dohyun and Y. Bong Jin (2005), Collaborative filtering based on iterative principal component analysis, Expert Syst. Appl., 28(4): 823–830.

[6] J. L. Herlocker, J. A. Konstan, L. G. Terveen, and J. T. Riedl (2004), Evaluating collaborative filtering recommender systems, ACM Trans. Inf. Syst. TOIS, 22(1): 5–53, 2004.

[7] B. Sarwar, G. Karypis, J. Konstan, and J. Reidl (2001), Item-based collaborative filtering recommendation algorithms, Proceedings of the 10th international conference on World Wide Web, 285–295.

[8] J. A. Konstan, B. N. Miller, D. Maltz, J. L. Herlocker, L. R. Gordon, and J. Riedl (1997), GroupLens: applying collaborative filtering to Usenet news, Commun. ACM, 40(3): 77–87.

[9] J. Wang, S. C. H. Hoi, P. Zhao, and Z.-Y. Liu (2013), Online multi-task collaborative filtering for on-the-fly recommender systems, Proceedings of the 7th ACM conference on Recommender systems, 2013, 237–244.

[10] K. Yehuda and I. Haifa (2010), Collaborative filtering with temporal dynamics, Commun. ACM, 53(4): 89–97.

[11] J. Z. Kolter and M. Maloof (2003), Dynamic weighted majority: a new ensemble method for tracking concept drift, ICDM 2003. Third IEEE International Conference on, 123–130.

[12] D. Wang, P. Wu, P. Zhao, Y. Wu, C. Miao, and S. C. H. Hoi (2014), High-Dimensional Data Stream Classification via Sparse Online Learning, Data Mining (ICDM), 2014 IEEE International Conference on, 1007–1012.

[13] J. Abernethy, K. Canini, J. Langford, and A. Simma (2007), Online collaborative filtering, Univ. Calif. Berkeley Tech Rep, 2007.

[14] M. Ali, C. C. Campbell, and A. K. Tang (2011), Parallel Collaborative Filtering for Streaming Data,

[15] J. Wilson, S. Chaudhury, B. Lall, and P. Kapadia (2014), Improving Collaborative Filtering based Recommenders using Topic Modelling, Web Intelligence, 340–346.

[16] T. Hofmann (2004), Latent semantic models for collaborative filtering, ACM Trans. Inf. Syst., v 22(1): 89–115.

[17] R. Salakhutdinov, A. Mnih, and G. Hinton (2007), Restricted Boltzmann machines for collaborative filtering, Proceedings of the 24th international conference on Machine learning, 791–798.

[18] Li M; Wu C; Zhang L; You LN (2015), An Intuitionistic Fuzzy-Todim Method To Solve Distributor Evaluation And Selection Problem, International Journal Of Simulation Modelling, 14(3): 511-524.

[19] A. Mnih and R. Salakhutdinov (2007), Probabilistic matrix factorization, Advances in neural information processing systems, 1257–1264.

[20] G. Rainer, N. Nrik, H. Peter J., and S. Yannis (2011), Large-scale matrix factorization with distributed stochastic gradient descent, Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining, 69–77.

[21] Saric T; Simunovic G; Simunovic K (2013), Use Of Neural Networks In Prediction And Simulation Of Steel Surface Roughness, International Journal Of Simulation Modelling, 12(4): 225-236.

[22] R. M. Bell, Y. Koren, and C. Volinsky (2007), The BellKor solution to the Netflix Prize,, 1-15.

[23] J. Bennett and S. Lanning (2007), The Netflix Prize, KDD Cup Workshop Conjunction KDD, 2007.

[24] Z. Qiao, P. Zhang, J. He, Y. Cao, C. Zhou, and L. Guo (2014), Combining geographical information of users and content of items for accurate rating prediction, Proceedings of the companion publication of the 23rd international conference on World wide web companion, 361–362.

[25] W. Li and D. Yeung (2011), Social Relations Model for Collaborative Filtering, Twenty-Fifth AAAI Conference on Artificial Intelligence, 803-808.

[26] Ocevcic Hrvoje; Nenadic Kresimir; Solic Kresimir (2014), Decision Support Based On The Risk Assessment Of Information Systems And Bayesian Learning, Tehnicki Vjesnik- Technical Gazette, 21(3): 539-544.

[27] Y. Koren, R. Bell, and C. Volinsky (2009), Matrix factorization techniques for recommender systems, Computer, 8: 30–37.

[28] M. Julien, B. Francis, P. Jean, and S. Guillermo (2010), Online Learning for Matrix Factorization and Sparse Coding, J. Mach. Learn. Res., 11: 19–60.

[29] S. Shalev-Shwartz (2011), Online Learning and Online Convex Optimization, Found. Trends Mach. Learn., 4(2): 107–194.

[30] R. Pálovics, A. A. Benczúr, L. Kocsis, T. Kiss, and E. Frigó (2014), Exploiting temporal influence in online recommendation, 273–280.

[31] G. Ling, H. Yang, I. King, and M. R. Lyu (2012), Online Learning for Collaborative Filtering, IEEE World Congress on Computational Intelligence, Brisbane, Australia, 1 – 8.
How to Cite
LIN, Fan; ZHOU, Xiuze; ZENG, Wenhua. Sparse Online Learning for Collaborative Filtering. INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, [S.l.], v. 11, n. 2, p. 248-258, jan. 2016. ISSN 1841-9844. Available at: <>. Date accessed: 13 july 2020. doi:


Recommender systems, Collaborative Filtering, Online learning, SOCFI, SOCFII