Repositories list

• dtune

  Public
  Distributed DoRA Training through periodic weight averaging for finetuning/continual pretraining

  Python

  •1•0•0•0•Updated Oct 29, 2024Oct 29, 2024

• DistributedTraining

  Public
  Python

  •27•8•1•4•Updated May 30, 2024May 30, 2024

• lightning-Hivemind

  Public
  Lightning Training strategy for HiveMind

  Python

  •

  Apache License 2.0

  •5•1•0•0•Updated Apr 2, 2024Apr 2, 2024

• NewArchScrapBook

  Public
  Python

  •1•1•0•0•Updated Mar 12, 2024Mar 12, 2024

• CollaborativeTrainingSubnet

  Public
  Python

  •

  MIT License

  •9•0•0•0•Updated Feb 11, 2024Feb 11, 2024

• flask_DHT_bootstrap

  Public
  Python

  •0•0•0•0•Updated Jan 2, 2024Jan 2, 2024

• mindswarm

  Public
  Combining hivemind with the outdated swarm code

  Python

  •

  MIT License

  •0•0•0•0•Updated Nov 28, 2023Nov 28, 2023

• swarm

  Public
  Official code for "SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient"

  Python

  •16•0•0•0•Updated Nov 25, 2023Nov 25, 2023