National Computational Infrastructure

NCI

Vayu: Retired September 2013

Vayu-16

Vayu, named after the Lord of the Winds, a primary Hindu deity, was a Sun/Oracle Constellation distributed-memory cluster that was procured with funding from the Australian Government through its National Collaborative Research Infrastructure Strategy (NCRIS).

Services from the system were initiated in September 2009, and were progressively expanded in two tranches, in January and April 2010.

Its last configuration was:

  • 11,936 cores (Intel Xeon Nehalem, 2.93 GHz) in 1492 compute nodes;
  • 37 TBytes (approx.) of main memory;
  • Infiniband QDR interconnect; and
  • 800 Tbytes (approx.) of usable fast filesystem (for short-term scratch space).

This provided a:

  • Peak performance of approximately 140 TFlops;
  • Sustained processor performance (SPECfp_rate_2006) of approximately 250,000.

The unit of shared memory parallelism was the node, which comprises dual 4-core Intel Xeon (Nehalem) processors, i.e., 8 cores.

The memory specification across the nodes was heterogeneous in order to provide a configuration capable of accommodating the requirements of most applications, and providing also for large-memory jobs.  Of the 1492 compute nodes:

  • 1440 nodes had 24 GBytes of memory;
  • 48 nodes had 48 GBytes of memory; and
  • 4 nodes had 96 Gbytes of memory.

Vayu was configured with the:

  • CentOS operating system (RHEL 6.3);
  • oneSIS cluster manager;
  • National Facility variant of the OpenPBS batch queuing system.

In Collaboration With