Computer cluster
A computer cluster is a group of connected computers that work together as a unit. One of the more popular implementations is a cluster with nodes running Linux as the OS and free software to implement the parallelism. This configuration is often referred to as a Beowulf cluster. Sun Microsystems has also released a clustering product called Grid engine. OpenSSI is another clustering project that provides single-system image capabilities. It leverages HP's NonStop Clusters for Unixware technology and other open source technology to provide a full, highly reliable SSI environment for Linux.
Cluster Types
There are fundamentally four types of clusters:
- Director-based clusters
- Two-node clusters
- Multi-node clusters
- Massively parallel clusters
All mature (or highly available) cluster implementations attempt to eliminate single points of failure. Director-based clusters and Beowulf clusters are typically implemented for performance reasons, while two-node clusters are typically implemented for fault-tolerance.
A cluster of computers is referred to as a server farm when the computers are used to mimic the operations of a single server machine.
Cluster Implementations
An organization publishes the 500 fastest clusters twice a year. Top 500 (http://top500.org) is a collaboration between the University of Mannheim, the University of Tennessee, and the National Energy Research Scientific Computing Center at Lawrence Berkeley National Laboratory. The current top supercomputer is the Department of Energy's BlueGene/L system with performance of 70.72 TFlops beating out number 2 by over 18 TFlops.
Clustering can provide significant performance benefits versus price. The System X supercomputer at Virginia Tech, the third most powerful supercomputer on Earth as of November 2003, is a computer cluster of 1100 Apple Power Macintosh G5s running Mac OS X. The total cost of the system is $5.2 million, a tenth of the cost of slower mainframe supercomputers. The Power Mac G5s have now been replaced with Apple's Xserve G5 machines, which are smaller, reducing the size of the cluster. The Xserves still run Mac OS X. The Power Mac G5s were sold off.
The central concept of a Beowulf cluster is using COTS machines to produce a cost-effective alternative to a traditional supercomputer.
Cluster History
Clusters were originally developed by DEC in the 1980s for the VAX/VMS operating system. They not only support parallel computing, but also shared file systems and peripheral devices. They are supposed to give you the advantage of parallel processing while maintaining data reliability and uniqueness.
Cluster Technologies
In the GNU/Linux world, there is also cluster software, such as the Linux Virtual Server, distcc, Kerrighed, Mosix and its free counterpart openMosix. LVS clusters are a form of director-based clusters that allow incoming requests for services to be distributed across multiple cluster nodes. Mosix and openMosix provide automatic process migration in a homogeneous cluster of GNU/Linux machines, while distcc provides parallel compilation when using GCC. Kerrighed is a GNU/Linux based operating system providing an SMP machine on top of a cluster of PCs.
DragonFly BSD, a recent fork of FreeBSD 4.8 is being redesigned at its core to enable native clustering capabilities.
MPI is a widely-available communications library that enables parallel programs to be written in C and Fortran.
See also
External links
- Beowulf.org (http://www.beowulf.org/)
- Top 500 Supercomputer List (http://www.top500.org/)
- Cplant, a non-Beowulf Linux cluster (http://www.cs.sandia.gov/cplant)
- IEEE task force on cluster computing, the leading academic community on cluster computing (http://www.ieeetfcc.org/)
References
- Greg Pfister: In Search of Clusters, Prentice Hall, ISBN 0138997098
da:Klyngecomputer de:Computercluster ko:컴퓨터 클러스터 ja:コンピュータ・クラスター pl:Klaster komputerowy