NCI InfiniCloud: Extending high performance InfiniBand capabilities in the NCI OpenStack Clouds

NCI operates compute resources on the Raijin supercomputer and  a number of OpenStack based Cloud facilities which provide a variety of flavours of HPC capabilities for Australian researchers.

The existing NCI HPC and Cloud offerings differ in their I/O capabilities. With HPC providing high speed InfiniBand connected storage and interprocess communication and Cloud traditionally using locally connect solid state disks and Ethernet based interprocess communication.

To support a more homogenous mix of capabilities the NCP Cloud team have extended the HPC InfiniBand fabric into Virtual Machine instances enabling flexible resource provisioning for Cloud while supporting a common framework shared with the Raijin supercomputer for high speed communications and storage access.

Using the RDMA capabilities of Infiniband combined with an intercontinental fabric connection, large datasets transfers of bioinformatics at around 9 Mbytes/s between Australia and Singapore has been demonstrated.

Andrew Howard and Jakub Chrzeszczyk
National Computational Infrastructure

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s