Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor dMoE #75

Merged
merged 7 commits into from
Feb 19, 2024
Merged

Refactor dMoE #75

merged 7 commits into from
Feb 19, 2024

Commits on Feb 17, 2024

  1. Update import paths in LlaMoE and train_moe files

    @NouamaneTazi
    NouamaneTazi committed Feb 17, 2024
    Configuration menu
    Copy the full SHA
    1f91dfe View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2024

  1. .

    @NouamaneTazi
    NouamaneTazi committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    69b45de View commit details
    Browse the repository at this point in the history

  2. Refactor dMoE

    @NouamaneTazi
    NouamaneTazi committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    7de0c31 View commit details
    Browse the repository at this point in the history

  3. we should shard data for expert_pg instead of loading expert unique b… 

    …atches
    @NouamaneTazi
    NouamaneTazi committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    ff95423 View commit details
    Browse the repository at this point in the history

  4. .

    @NouamaneTazi
    NouamaneTazi committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    86ec896 View commit details
    Browse the repository at this point in the history

  5. .

    @NouamaneTazi
    NouamaneTazi committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    9d28530 View commit details
    Browse the repository at this point in the history

  6. .

    @NouamaneTazi
    NouamaneTazi committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    65e6904 View commit details
    Browse the repository at this point in the history