NCI’s newest supercomputer is Gadi, a 3,200-node supercomputer supplied by Fujitsu Australia. Named Gadi (pronounced 'gar dee') after the words “to search for” in the language of the Ngunnawal people, the traditional owners of the Canberra region, Gadi is Australia's peak research supercomputer for 2020 and beyond.

Black mesh cabinets with silver computer servers, cables and lights visible inside them.

Gadi offers a 5-10 times increase in computational performance, and a significantly increased number of GPUs compared to its predecessor the Raijin supercomputer. This provides significant benefits for the largest parallel codes in particular, and all users will benefit from shorter queues and higher throughput. 

Gadi first launched to NCI users in mid-November 2019. The public launch is phased, with the first portion of the new machine launching in November and the second phase launching in January 2020. User documentation about the new machine is on our dedicated information page.

The Gadi installation is documented on our dedicated blog, click here to see the latest progress.

Technical Specifications

  • When complete, Gadi will include around 3,000 nodes containing Intel's second-generation Xeon Scalable ‘Cascade Lake’ processor with two 24-core CPUs and 192 Gigabytes of RAM per node.
  • Gadi will also include 160 nodes containing 640 Nvidia V100 GPUs, and 50 large-memory 'Cascade Lake' nodes offering 1.5 Terabytes of Intel Optane DC Persistent memory.
  • Linking the storage and the computer is Mellanox Technologies' latest generation HDR InfiniBand technology in a Dragonfly+ topology, capable of transferring data at 200 Gb/s.
  • The underlying storage sub-systems are provided by NetApp enterprise class storage arrays, linked together in a DDN Lustre parallel file system enabling the high-performance throughput needed for computing on big data challenges.
  • Altair’s PBSPro software optimises job scheduling and workload management.
  • Gadi uses the latest version of the CentOS 8 operating system.

NCI’s previous supercomputer is a hybrid Fujitsu Primergy-Lenovo NeXtScale system called Raijin. Named after the Shinto god of thunder, lightning and storms, Raijin is a high-performance, distributed memory cluster with a peak performance of over 2 petaflops.

Image of HPC system

Raijin was originally installed in 2012 and entered full production in June 2013. Significant updates to the system entered production in November 2016 and again in mid-2017. 

Since coming online, NCI’s computational systems have evolved from a relatively straightforward x86-based cluster to a heterogeneous one made up of many different systems. Over its operational life, Raijin has been augmented with a wide variety of x86 and non-x86 based systems, including GPUs, many-core Xeon Phi processors and Power8 processors.

The entire Raijin cluster runs the same operating system, an optimised version of the highly-customised, NCI-developed Linux kernel. 

Raijin is made up of

  • 89,256 cores in 4,500 Intel Xeon Sandy Bridge, Broadwell and Skylake nodes
  • 128 GPUs in 32 NVIDIA Tesla K80 and P100 nodes
  • 32 64-core Intel Xeon Phi processors in 32 nodes
  • 64 cores in 4 IBM Power8 nodes 
  • 300 terabytes of memory
  • 8 petabytes of operational disk storage
  • Hybrid FDR/EDR Mellanox Infiniband full fat tree interconnect (up to 100 Gb/sec)