header software2

This website uses cookies to manage authentication, navigation, and other functions. By using our website, you agree that we can place these types of cookies on your device.

View e-Privacy Directive Documents

SIONlib is one of the core components of the highly-scalable, parallel I/O stack in DEEP-EST.

  

The parallel I/O library SIONlib enables large-scale parallel applications to perform efficient parallel I/O to task local files.

 

This is done by mapping file operations on individual files to file operations on one or few shared files. At very large scale, parallel I/O to task local files does not perform on current parallel file systems. One of the critical bottlenecks is thereby the management of the file meta-data. By replacing I/O operations to individual files with collective I/O operations to a shared file, SIONlib is able to reduce the number of such file management operations to a minimum.

 

In the DEEP-EST project, the adaptation of SIONlib to modular architectures has made further progress. The collective I/O mechanism has been extended by an MSA-aware mode of operation, that assigns the collector role to tasks running on a partition that is well suited for performing I/O. A custom I/O forwarding solution has been implemented that can be used to utilize nodes from partitions that are not running the user application for the purpose of I/O. Read and write functions can now use GPU memory buffers for input and output.

 

These new features have been included in the most recent releases of SIONlib (since December 2019). The documentation and the latest version for download can be found here: https://www.fz-juelich.de/jsc/sionlib.