Skip to content

megatron-wrap v1.0.0

Latest
Compare
Choose a tag to compare
@0-1CxH 0-1CxH released this 23 Dec 05:22

What's Changed

  • Milestone 1: Mock train llama 2 7B model by @0-1CxH in #1
  • Milestone 2: wrap context parallel by @0-1CxH in #2
  • Milestone 3: add sft training flow and wandb logger by @0-1CxH in #3

New Contributors

  • @0-1CxH made their first contribution in #1

Full Changelog: https://github.com/0-1CxH/megatron-wrap/commits/v1.0.0