Zennyo
Pre-releaseDragon 0.61 Release Summary
This package is the first to extend Dragon beyond support for Python multiprocessing. The key new feature is support for running collections of executables, including executables that require support for PMI (e.g., MPI). PMI support is currently limited to executables using Cray PMI, such as those linked with Cray MPICH. The process group feature is also utilized for scalable multiprocessing Pool, which can now scale to thousands of workers. Highlighted new features are:
- ProcessGroup API for scalable management of processes
- Initial support for managing process requiring PMI (e.g., MPI)
- Rewrite of mp.Pool utilizing ProcessGroup
- mp.Array
- HPC workflow cookbook entry orchestrating MPI and Python processes
- Processing pipeline cookbook example
- LICENSE is now MIT
To extract the package,
tar -zxvf dragon-0.61-100f20e0.tar.gz
Then you can change to the dragon-0.61 directory and follow directions given in the INSTALL.md file to install it on your system.
NOTE: Installing this package requires a Linux environment with a compatible GLIBC library. Additional requirements are listed in our documentation at dragonhpc.org under the heading "Getting Started".