kanyun-inc / ytk-mp4j Star 107 Code Issues Pull requests Ytk-mp4j is a fast, user-friendly, cross-platform, multi-process, multi-thread collective message passing java library which includes gather, scatter, allgather, reduce-scatter, broadcast, reduce, allreduce communications for distributed machine learning. machine-learning openmp mpi reduce broadcast messaging-library allreduce Updated Jun 14, 2017 Java
wrathematics / spar Star 1 Code Issues Pull requests Sparse Allreduce mpi sparse sparse-matrices allreduce Updated Jul 7, 2020 C++
NiuHuangxiaozi / Deep-Learning-Parallelism Star 1 Code Issues Pull requests This repository outlines a comprehensive guide for training a distributed deep learning model. pytorch ps ddp allreduce pipline deepspeed tensor-parallelism Updated Jul 2, 2024 Python