A New Model for Cluster Communications Optimization

Authors

  • Andrei Rusan “Gheorghe Asachi” Technical University of IaÅŸi Department of Computer Science and Engineering, Adress: Bd. Dimitrie Mangeron, Nr. 53A, 700050, IaÅŸi, Romania
  • Cristian-Mihai Amarandei “Gheorghe Asachi” Technical University of IaÅŸi Department of Computer Science and Engineering, Adress: Bd. Dimitrie Mangeron, Nr. 53A, 700050, IaÅŸi, Romania

Keywords:

cluster communications optimization, network performance

Abstract

Performance losses of cluster applications can arise from various sources in the communications network of computer clusters. Typically, CPU intensive applications generate a small amount of network traffic the overall influence of the network subsystem is minimal. On the other hand, a dataintensive and network aware application generates a large amount of network traffic and the influence of the network subsystem is significantly greater. This paper presents a model that aims to improve the cluster’s network performance by reducing the data transfer time, this solution having the advantage that doesn’t imply modifications of the original applications or of the kernel.

References

T. Dunigan, M. Mathis, B. Tierney, A TCP tuning daemon, Conference on High Performance Networking and Computing, Proceedings of the 2002 ACM/IEEE conference on Supercomputing, Baltimore, Maryland, 2002

B.L. Tierney, TCP tuning guide for distributed application on wide area networks, Usenix;login. http://www-didc.lbl.gov/tcp-wan-perf.pdf, 2001

V. Jacobson, R. Braden, D. Borman, RFC1323 TCP Extensions for High Performance, May 1992

B.L Tierney, D. Gunter, J. Lee, M. Stoufer, J.B. Evans, Enabling network-aware applications, Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing, Page: 281-288, 2001, ISBN: 0-7695-1296-8 http://dx.doi.org/10.1109/HPDC.2001.945196

NetPIPE, webpage: http://www.scl.ameslab.gov/netpipe/

A. Tirumala, L. Cottrell, "Iperf Quick Mode", http://www-iepm.slac.stanford.edu/bw/ iperfres.html

Netperf homepage, http://www.netperf.org/netperf/NetperfPage.html

D. Turner, A. Oline, X. Chen, and T. Benjegerdes,Integrating New Capabilities into NetPIPE, Lecture Notes in Computer Science, Springer-Verlag, September 2003, pp. 37-44.

D. Turner, X. Chen, Protocol-Dependent Message-Passing Performance on Linux Clusters, Proceedings of the IEEE International Conference on Cluster Computing, September 2002, pp. 187-194. http://dx.doi.org/10.1109/clustr.2002.1137746

Q.O. Snell, A. Mikler, J.L. Gustafson, NetPIPE: A Network Protocol Independent Performance Evaluator, ASTED International Conference on Intelligent Information Management and Systems, June 1996.

H. Sivakumar, S. Bailey, R. L. Grossman,PSockets: The Case for Application-level Network Striping for Data Intensive Applications using High Speed Wide Area Networks, Proceedings of IEEE Supercomputing 2000, Nov., 2000, http://www.ncdm.uic.edu/html/psockets. html

J. Postel, RFC793 Transmission Control Protocol, September 1981

R. Braden , RFC1122 Requirements for Internet Hosts - Communication Layers, October 1989

V. Paxson, G. Almes, J. Mahdavi, M. Mathis, RFC 2330 Framework for IP Performance Metrics, May 1998

E. Ciliendo, T. Kunimasa, B. Braswell, Linux Performance and Tuning Guidelines, IBM, July 2007.

Published

2010-12-01

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.