NCI operates multiple high-speed, low-latency global parallel filesystems to support the most data-intensive research workloads
We run the fastest filesystems in the Southern Hemisphere, linking high-performance computing (HPC) with high-performance data (HPD) via 100-gigabit network links. NCI's filesystems, catering to the needs of our research community, enable the next generation of computational tasks, including High-Throughput Computing (HTC).
NCI’s filesystems contain around 90 Petabytes of data storage capacity, providing space for research data to be stored in five separate global Lustre filesystems, reaching a total aggregate IO performance of around 450 GB/second.
NCI also runs a special IO Intensive Platform, a dedicated filesystem using 576 2-Terabyte NVMe drives for a cumulative performance around 960 Gigabytes per second.
On top of this, NCI also stores 70+ Petabytes of archival project data in state of the art magnetic tape libraries. In total, NCI runs more than 15,000 hard drives from vendors including NetApp, DDN and HPE.
Our fastest filesystem, /scratch, provides data storage for active IO taking place on the Gadi supercomputer.
Technical Specifications /scratch
- 7,200 4-Terabyte hard disks in 120 NetApp disk arrays
- 20 Petabytes total useable capacity
- 980 Gigabytes per second maximum performance
| Filesystem | Capacity (Petabytes) | Purpose | Availability | Total Aggregate Performance | Maximum Performance |
|---|---|---|---|---|---|
| /scratch | 20 PB | Large and fast IO | Gadi only | 980 GB/s | 490 GB/s |
| /g/data1-6 | 90+ PB | Storage of large data files | Global | 450 GB/s | 150 GB/s |
| Massdata | 70+ PB | Archiving data files | External | 8 TB/hour | 8 TB/hour |
