Nofi wraps the existing rofi interface implemented by Pacific Northwest National Laboratory (PNNL). Nofi provides the Nim programming language support for RDMA distributed communication (put and get), fundamental operations for PGAS applications.
This library extends rofi by providing a sequence type that wraps memory registered with the underlying rofi RDMA communicaton library. The sequence type only supports values that are of SomeNumber types. The sequence type provides element-access, slice, iterator, and partitioning support.
Additional functionality is provided to handle asynchronous put and get operations using Nim's defer statements, combining templates with try statements, and futures.
Nim applications using nofi require static compilation and linking!
Download and install rofi
./configure --prefix=<PATH_TO_INSTALL_DIR>
make && make install
export LD_LIBRARY_PATH=<PATH_TO_INSTALL_DIR>/lib:$LD_LIBRARY_PATH
Modify makefile to point LIBDIR and INCDIR to the
path set in <PATH_TO_INSTALL_DIR>. Use the makefile to
see if your setup compiles.
make
Use the nimble tool to install nofi
nimble install nofi
Generate documentation from source
nimble doc nofi
Nofi demonstrates the versitility of the rofi library and it's value as a lightweight technology for extending RDMA support via libfabric to languages that have a FFI (foreign function interface) compatible with C.
Users need to review the rofi documentation prior to using this library in order to understand rofi's feature set and potential limitations.
This library requires static compilation of an end user's
Nim program. Please review the makefile to learn how to
enable static compilation and linking with the Nim compiler.
Users must initialize and terminate all programs using
nofi_init and nofi_finit. Not taking this step will
result in undefined behavior.
Users are strongly encouraged to utilize Nim blocks and scoping rules to managing memory that has been registered with nofi. Users can review 'tests/test_sharray.nim' for an example of memory management using Nim blocks and scopes.
The directory 'tests/' provides several examples regarding how to interact with this library.
- nofi is Boost Version 1.0 (2022-)
- rofi is BSD License (2020)
24 February 2022
Christopher Taylor
- Roberto Gioiosa - roberto.gioiosa@pnnl.gov
- Ryan Friese - ryan.friese@pnnl.gov
- Mark Raugas - mark.raugas@pnnl.gov
- Pacific Northwest National Labs/US Department of Energy
- The Nim community and user/developer forum
- GNU Autotools
- libfabric
- libibverbs
- uthash
- libatomic
- librt: Extended realtime library, generally installed on Linux development clusters
- pthreads: POSIX thread library, generally installed on Linux development clusters