The Research of Differentiated Service and Load Balancing in Web Cluster

Ang Gao, Quan Pan, Yansu Hu


Differentiated service, as a key solution to meet the heterogenicity ofWeb clients’ QoS requirements, has been widely used to optimize the server utilization without over-providing resources. Based on the relative differentiated service, this paper treats the application of proportional delay as a optimal control problem, and focuses on the cluster-side architecture improvement as well as QoS controller design. A load balancingWeb cluster architecture supported differentiated service is proposed and implemented. By system identification and resource optimal control, the frontend dispatcher could adjust the resource quotas assigned to different classes in every single back-end server, and Multi-class based Maximum Idle First load balancing strategy is designed to ensure a fair resource consumption among back-end nodes. As a result, the end-to-end delay is controlled and proportional delay is guaranteed. The experiments demonstrate that no matter using Round-Robin, Least Connection Scheduling or Maximum Idle First load balancing strategy, the proposed resource optimal controller could hold the relationship among different classes. Compared to Round-Robin and Least Connection First Scheduling, Maximum Idle First strategy increases the cluster throughput by 33% and reduces the average delay by 21%.


Differentiated Service, Maximum Idle First, Load Balancing, Proportional Delay Guarantee

Full Text:



M. Andreolini, E. Casalicchio, M. Colajanni, and M. Mambelli. A cluster-based web system providing differentiated and guaranteed services. Cluster Computing, 7(1):7–19, 2004.

G. Ang, M. Dejun, H. Yansu, and P. Wenping. Proportional Delay Guarantee in Web QoS Based on Predictive Control. In Information Science and Engineering (ICISE), 2009 1st International Conference on, pages 1789–1792. IEEE, 2009.

G. Apostolopoulos, D. Aubespin, V. Peris, P. Pradhan, and D. Saha. Design, Implementation, and Performance of a Content-Based Switch. In IEEE INFOCOM, volume 3, pages 1117–1126. Citeseer, 2000.

E. Casalicchio and M. Colajanni. A client-aware dispatching algorithm for web clusters providing multiple services. In Proceedings of the 10th international conference on World Wide Web, page 544. ACM, 2001.

L. Cherkasova and M. Karlsson. Scalable web server cluster design with workload-aware request distribution strategy WARD. In wecwis, page 0212. Published by the IEEE Computer Society, 2001.

JBoss Community.

A. Gao, D. Mu, and Y. Hu. A QoS Control Approach in DifferentiatedWeb Caching Service. Journal of Networks, 6(1):62–70, 2011.

A. Gao, D. Mu, Y. Hu, and W. Pan. Proportional Delay Guarantee in Web QoS Based on Predictive Control. 1st International Conference on Information Science and Engineering, ICISE2009, 1:1789–1792, 2009.

A. Gao, H. Zhou, Y. Hu, D. Mu, and W. Hu. Proportional Delay Differentiation Service and Load Balancing in Web Cluster Systems. In INFOCOM IEEE Conference on Computer Communications Workshops, 2010, pages 1–2. IEEE, 2010.

M. Karlsson, X. Zhu, and C. Karamanolis. An adaptive optimal controller for nonintrusive performance differentiation in computing services. In Control and Automation, 2005. ICCA'05. International Conference on, volume 2, pages 709–714. IEEE.

A.F. Liu. Research on the Web Server Cluster Technologies. PhD thesis, Central South Univercity, 2005.

X. Liu, X. Zhu, P. Padala, Z. Wang, and S. Singhal. Optimal multivariate control for differentiated services on a shared hosting platform. In Proc. of the 46th IEEE Conf. on Decision and Control. Citeseer, 2007.

V.S. Pai, M. Aron, G. Banga, M. Svendsen, P. Druschel, W. Zwaenepoel, and E. Nahum. Locality-aware request distribution in cluster-based network servers. In Proceedings of the eighth international conference on Architectural support for programming languages and operating systems, pages 205–216. ACM, 1998.

W. Pan, D. Mu, H. Wu, and Q. Sun. Proportional Delay Differentiation Service in Web Application Servers: A Feedback Control Approach. International Journal of Intelligent Information Technology Application, 1(1):37–42, 2008.

A. Robertson. Linux-HA heartbeat system design. In Proceedings of the 4th annual Linux Showcase & Conference-Volume 4, pages 20–20. USENIX Association, 2000.

A. Robertson. The evolution of the Linux-HA project. In UKUUG LISA/Winter Conference High-Availability and Reliability, 2004.

T. Schroeder, S. Goddard, and B. Ramamurthy. ScalableWeb server clustering technologies. IEEE network, 14(3):38–45, 2000.

Z.G. Shan and C. Ling. Performance Evaluation of QoS-Aware Load Balancing ofWeb-server Clusters. Journal of System Simulation in chinese, 17:184–189, 2005.

X. Wu, M. Li, and J. Wu. Enhanced Demand-driven Service Differentiation Algorithm in Web Clusters. In IEEE International Conference on e-Business Engineering, 2006. ICEBE'06, pages 386–391, 2006.

Z. Xing, P.L. Yan, and C.C. Guo. Proportional Stretch Factor Differentiated Service in Heterogeneous Web Server Cluster. Computer Science in chinese, 33(010):61–65, 2006.

H. Zhu, H. Tang, and T. Yang. Demand-driven service differentiation in cluster-based network servers. In IEEE INFOCOM, volume 2, pages 679–688. Citeseer, 2001.


Copyright (c) 2017 Ang Gao, Quan Pan, Yansu Hu

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

CC-BY-NC  License for Website User

Articles published in IJCCC user license are protected by copyright.

Users can access, download, copy, translate the IJCCC articles for non-commercial purposes provided that users, but cannot redistribute, display or adapt:

  • Cite the article using an appropriate bibliographic citation: author(s), article title, journal, volume, issue, page numbers, year of publication, DOI, and the link to the definitive published version on IJCCC website;
  • Maintain the integrity of the IJCCC article;
  • Retain the copyright notices and links to these terms and conditions so it is clear to other users what can and what cannot be done with the  article;
  • Ensure that, for any content in the IJCCC article that is identified as belonging to a third party, any re-use complies with the copyright policies of that third party;
  • Any translations must prominently display the statement: "This is an unofficial translation of an article that appeared in IJCCC. Agora University  has not endorsed this translation."

This is a non commercial license where the use of published articles for commercial purposes is forbiden. 

Commercial purposes include: 

  • Copying or downloading IJCCC articles, or linking to such postings, for further redistribution, sale or licensing, for a fee;
  • Copying, downloading or posting by a site or service that incorporates advertising with such content;
  • The inclusion or incorporation of article content in other works or services (other than normal quotations with an appropriate citation) that is then available for sale or licensing, for a fee;
  • Use of IJCCC articles or article content (other than normal quotations with appropriate citation) by for-profit organizations for promotional purposes, whether for a fee or otherwise;
  • Use for the purposes of monetary reward by means of sale, resale, license, loan, transfer or other form of commercial exploitation;

    The licensor cannot revoke these freedoms as long as you follow the license terms.

[End of CC-BY-NC  License for Website User]

INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL (IJCCC), With Emphasis on the Integration of Three Technologies (C & C & C),  ISSN 1841-9836.

IJCCC was founded in 2006,  at Agora University, by  Ioan DZITAC (Editor-in-Chief),  Florin Gheorghe FILIP (Editor-in-Chief), and  Misu-Jan MANOLESCU (Managing Editor).

Ethics: This journal is a member of, and subscribes to the principles of, the Committee on Publication Ethics (COPE).

Ioan  DZITAC (Editor-in-Chief) at COPE European Seminar, Bruxelles, 2015:

IJCCC is covered/indexed/abstracted in Science Citation Index Expanded (since vol.1(S),  2006); JCR2018: IF=1.585..

IJCCC is indexed in Scopus from 2008 (CiteScore2018 = 1.56):

Nomination by Elsevier for Journal Excellence Award Romania 2015 (SNIP2014 = 1.029): Elsevier/ Scopus

IJCCC was nominated by Elsevier for Journal Excellence Award - "Scopus Awards Romania 2015" (SNIP2014 = 1.029).

IJCCC is in Top 3 of 157 Romanian journals indexed by Scopus (in all fields) and No.1 in Computer Science field by Elsevier/ Scopus.


 Impact Factor in JCR2018 (Clarivate Analytics/SCI Expanded/ISI Web of Science): IF=1.585 (Q3). Scopus: CiteScore2018=1.56 (Q2);

SCImago Journal & Country Rank

Editors-in-Chief: Ioan DZITAC & Florin Gheorghe FILIP.