Sparse Online Learning for Collaborative Filtering

Fan Lin, Xiuze Zhou, Wenhua Zeng

Abstract


With the rapid growth of Internet information, our individual processing capacity has become over-whelming. Thus, we really need recommender systems to provide us with items online in real time. In reality, a user’s interest and an item’s popularity are always changing over time. Therefore, recommendation approaches should take such changes into consideration. In this paper, we propose two approaches, i.e., First Order Sparse Collaborative Filtering (SOCFI) and Second Order Sparse Online Collaborative Filtering (SOCFII), to deal with the user-item ratings for online collaborative filtering. We conduct some experiments on such real data sets as Movie- Lens100K and MovieLens1M, to evaluate our proposed methods. The results show that, our proposed approach is able to effectively online update the recommendation model from a sequence of rating observation. And in terms of RMSE, our proposed approach outperforms other baseline methods.


Keywords


Recommender systems, Collaborative Filtering, Online learning, SOCFI, SOCFII

Full Text:

PDF

References


G. Linden, B. Smith, and J. York (2003), Amazon. com recommendations: Item-to-item collaborative filtering, Internet Comput. IEEE, 7(1): 76–80.
http://dx.doi.org/10.1109/MIC.2003.1167344

M. D. Ekstrand, R. Join T., and K. Joseph A.(2011), Collaborative Filtering Recommender Systems, Found. Trends® Human–Computer Interact., 4(2): 81–173.
http://dx.doi.org/10.1561/1100000009

Z. Wang and H. Lu (2014), Online Recommender System Based on Social Network Regularization, Neural Inf. Process., 487–494, Nov. 2014.

J. B. Schafer, J. Konstan, and J. Riedl (1999), Recommender systems in e-commerce, Electronic Commerce, 158–166.

K. Dohyun and Y. Bong Jin (2005), Collaborative filtering based on iterative principal component analysis, Expert Syst. Appl., 28(4): 823–830.
http://dx.doi.org/10.1016/j.eswa.2004.12.037

J. L. Herlocker, J. A. Konstan, L. G. Terveen, and J. T. Riedl (2004), Evaluating collaborative filtering recommender systems, ACM Trans. Inf. Syst. TOIS, 22(1): 5–53, 2004.
http://dx.doi.org/10.1145/963770.963772

B. Sarwar, G. Karypis, J. Konstan, and J. Reidl (2001), Item-based collaborative filtering recommendation algorithms, Proceedings of the 10th international conference on World Wide Web, 285–295.
http://dx.doi.org/10.1145/371920.372071

J. A. Konstan, B. N. Miller, D. Maltz, J. L. Herlocker, L. R. Gordon, and J. Riedl (1997), GroupLens: applying collaborative filtering to Usenet news, Commun. ACM, 40(3): 77–87.
http://dx.doi.org/10.1145/245108.245126

J. Wang, S. C. H. Hoi, P. Zhao, and Z.-Y. Liu (2013), Online multi-task collaborative filtering for on-the-fly recommender systems, Proceedings of the 7th ACM conference on Recommender systems, 2013, 237–244.
http://dx.doi.org/10.1145/2507157.2507176

K. Yehuda and I. Haifa (2010), Collaborative filtering with temporal dynamics, Commun. ACM, 53(4): 89–97.
http://dx.doi.org/10.1145/1721654.1721677

J. Z. Kolter and M. Maloof (2003), Dynamic weighted majority: a new ensemble method for tracking concept drift, ICDM 2003. Third IEEE International Conference on, 123–130.
http://dx.doi.org/10.1109/ICDM.2003.1250911

D. Wang, P. Wu, P. Zhao, Y. Wu, C. Miao, and S. C. H. Hoi (2014), High-Dimensional Data Stream Classification via Sparse Online Learning, Data Mining (ICDM), 2014 IEEE International Conference on, 1007–1012.

J. Abernethy, K. Canini, J. Langford, and A. Simma (2007), Online collaborative filtering, Univ. Calif. Berkeley Tech Rep, 2007.

M. Ali, C. C. Campbell, and A. K. Tang (2011), Parallel Collaborative Filtering for Streaming Data, http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.230.8613.

J. Wilson, S. Chaudhury, B. Lall, and P. Kapadia (2014), Improving Collaborative Filtering based Recommenders using Topic Modelling, Web Intelligence, 340–346.

T. Hofmann (2004), Latent semantic models for collaborative filtering, ACM Trans. Inf. Syst., v 22(1): 89–115.
http://dx.doi.org/10.1145/963770.963774

R. Salakhutdinov, A. Mnih, and G. Hinton (2007), Restricted Boltzmann machines for collaborative filtering, Proceedings of the 24th international conference on Machine learning, 791–798.
http://dx.doi.org/10.1145/1273496.1273596

Li M; Wu C; Zhang L; You LN (2015), An Intuitionistic Fuzzy-Todim Method To Solve Distributor Evaluation And Selection Problem, International Journal Of Simulation Modelling, 14(3): 511-524.
http://dx.doi.org/10.2507/IJSIMM14(3)CO12

A. Mnih and R. Salakhutdinov (2007), Probabilistic matrix factorization, Advances in neural information processing systems, 1257–1264.

G. Rainer, N. Nrik, H. Peter J., and S. Yannis (2011), Large-scale matrix factorization with distributed stochastic gradient descent, Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining, 69–77.

Saric T; Simunovic G; Simunovic K (2013), Use Of Neural Networks In Prediction And Simulation Of Steel Surface Roughness, International Journal Of Simulation Modelling, 12(4): 225-236.
http://dx.doi.org/10.2507/IJSIMM12(4)2.241

R. M. Bell, Y. Koren, and C. Volinsky (2007), The BellKor solution to the Netflix Prize, http://www.netflixprize.com/assets/ProgressPrize2007_KorBell.pdf, 1-15.

J. Bennett and S. Lanning (2007), The Netflix Prize, KDD Cup Workshop Conjunction KDD, 2007.

Z. Qiao, P. Zhang, J. He, Y. Cao, C. Zhou, and L. Guo (2014), Combining geographical information of users and content of items for accurate rating prediction, Proceedings of the companion publication of the 23rd international conference on World wide web companion, 361–362.

W. Li and D. Yeung (2011), Social Relations Model for Collaborative Filtering, Twenty-Fifth AAAI Conference on Artificial Intelligence, 803-808.

Ocevcic Hrvoje; Nenadic Kresimir; Solic Kresimir (2014), Decision Support Based On The Risk Assessment Of Information Systems And Bayesian Learning, Tehnicki Vjesnik- Technical Gazette, 21(3): 539-544.

Y. Koren, R. Bell, and C. Volinsky (2009), Matrix factorization techniques for recommender systems, Computer, 8: 30–37.
http://dx.doi.org/10.1109/MC.2009.263

M. Julien, B. Francis, P. Jean, and S. Guillermo (2010), Online Learning for Matrix Factorization and Sparse Coding, J. Mach. Learn. Res., 11: 19–60.

S. Shalev-Shwartz (2011), Online Learning and Online Convex Optimization, Found. Trends Mach. Learn., 4(2): 107–194.
http://dx.doi.org/10.1561/2200000018

R. Pálovics, A. A. Benczúr, L. Kocsis, T. Kiss, and E. Frigó (2014), Exploiting temporal influence in online recommendation, 273–280.

G. Ling, H. Yang, I. King, and M. R. Lyu (2012), Online Learning for Collaborative Filtering, IEEE World Congress on Computational Intelligence, Brisbane, Australia, 1 – 8.




DOI: https://doi.org/10.15837/ijccc.2016.2.2144



Copyright (c) 2017 Fan Lin, Xiuze Zhou, Wenhua Zeng

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

CC-BY-NC  License for Website User

Articles published in IJCCC user license are protected by copyright.

Users can access, download, copy, translate the IJCCC articles for non-commercial purposes provided that users, but cannot redistribute, display or adapt:

  • Cite the article using an appropriate bibliographic citation: author(s), article title, journal, volume, issue, page numbers, year of publication, DOI, and the link to the definitive published version on IJCCC website;
  • Maintain the integrity of the IJCCC article;
  • Retain the copyright notices and links to these terms and conditions so it is clear to other users what can and what cannot be done with the  article;
  • Ensure that, for any content in the IJCCC article that is identified as belonging to a third party, any re-use complies with the copyright policies of that third party;
  • Any translations must prominently display the statement: "This is an unofficial translation of an article that appeared in IJCCC. Agora University  has not endorsed this translation."

This is a non commercial license where the use of published articles for commercial purposes is forbiden. 

Commercial purposes include: 

  • Copying or downloading IJCCC articles, or linking to such postings, for further redistribution, sale or licensing, for a fee;
  • Copying, downloading or posting by a site or service that incorporates advertising with such content;
  • The inclusion or incorporation of article content in other works or services (other than normal quotations with an appropriate citation) that is then available for sale or licensing, for a fee;
  • Use of IJCCC articles or article content (other than normal quotations with appropriate citation) by for-profit organizations for promotional purposes, whether for a fee or otherwise;
  • Use for the purposes of monetary reward by means of sale, resale, license, loan, transfer or other form of commercial exploitation;

    The licensor cannot revoke these freedoms as long as you follow the license terms.

[End of CC-BY-NC  License for Website User]


INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL (IJCCC), With Emphasis on the Integration of Three Technologies (C & C & C),  ISSN 1841-9836.

IJCCC was founded in 2006,  at Agora University, by  Ioan DZITAC (Editor-in-Chief),  Florin Gheorghe FILIP (Editor-in-Chief), and  Misu-Jan MANOLESCU (Managing Editor).

Ethics: This journal is a member of, and subscribes to the principles of, the Committee on Publication Ethics (COPE).

Ioan  DZITAC (Editor-in-Chief) at COPE European Seminar, Bruxelles, 2015:

IJCCC is covered/indexed/abstracted in Science Citation Index Expanded (since vol.1(S),  2006); JCR2018: IF=1.585..

IJCCC is indexed in Scopus from 2008 (CiteScore2018 = 1.56):

Nomination by Elsevier for Journal Excellence Award Romania 2015 (SNIP2014 = 1.029): Elsevier/ Scopus

IJCCC was nominated by Elsevier for Journal Excellence Award - "Scopus Awards Romania 2015" (SNIP2014 = 1.029).

IJCCC is in Top 3 of 157 Romanian journals indexed by Scopus (in all fields) and No.1 in Computer Science field by Elsevier/ Scopus.

 

 Impact Factor in JCR2018 (Clarivate Analytics/SCI Expanded/ISI Web of Science): IF=1.585 (Q3). Scopus: CiteScore2018=1.56 (Q2); Editors-in-Chief: Ioan DZITAC & Florin Gheorghe FILIP.