Skip to content

Zennyo

Pre-release
Pre-release
Compare
Choose a tag to compare
@kentdlee kentdlee released this 21 Sep 22:03
· 24 commits to main since this release
d9f0955

Dragon 0.61 Release Summary

This package is the first to extend Dragon beyond support for Python multiprocessing. The key new feature is support for running collections of executables, including executables that require support for PMI (e.g., MPI). PMI support is currently limited to executables using Cray PMI, such as those linked with Cray MPICH. The process group feature is also utilized for scalable multiprocessing Pool, which can now scale to thousands of workers. Highlighted new features are:

  • ProcessGroup API for scalable management of processes
  • Initial support for managing process requiring PMI (e.g., MPI)
  • Rewrite of mp.Pool utilizing ProcessGroup
  • mp.Array
  • HPC workflow cookbook entry orchestrating MPI and Python processes
  • Processing pipeline cookbook example
  • LICENSE is now MIT

To extract the package,

tar -zxvf dragon-0.61-100f20e0.tar.gz

Then you can change to the dragon-0.61 directory and follow directions given in the INSTALL.md file to install it on your system.

NOTE: Installing this package requires a Linux environment with a compatible GLIBC library. Additional requirements are listed in our documentation at dragonhpc.org under the heading "Getting Started".