National Computational Infrastructure

NCI

Raijin

NCI_Raijin_web-1

Raijin, named after the Shinto God of thunder, lightning and storms, is a Fujitsu Primergy high-performance, distributed-memory cluster, procured with funding from the Australian Government, through its Super Science Initiatives, under the EIF Climate HPC Centre Funding Agreement between the Commonwealth of Australia and the Australian National University.

The system was installed in 2012 and entered production use in June 2013. It comprises:

  • 57,472 cores (Intel Xeon Sandy Bridge technology, 2.6 GHz) in 3592 compute nodes
  • 160 TBytes of main memory
  • Infiniband FDR interconnect
  • 10 PBytes of usable fast filesystem (for short-term scratch space).

This provides a:

  • Peak performance of approximately 1.2 PFlops
  • An aggregate SPECfp_rate_2006 of 1.6M

The unit of shared memory parallelism is the node, which comprises dual 8-core Intel Xeon (Sandy Bridge 2.6 GHz) processors, i.e., 16 cores.

The memory specification across the nodes is heterogeneous in order to provide a configuration capable of accommodating the requirements of most applications, and providing also for large-memory jobs. Accordingly:

  • Two-thirds of the nodes have 32 GBytes, i.e., 2 GBytes/core;
  • Almost one-third of the nodes have 64 GBytes, i.e., 4 GBytes/core; while
  • Two (2) per cent of the nodes have 128 GBytes, i.e., 8 GBytes/core.

The Raijin system is configured with:

  • OneSIS cluster manager
  • PBS Professional job scheduler.

 

In Collaboration With