Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Draft] OpenSora Llama3 Internal #702

Draft
wants to merge 14 commits into
base: master
Choose a base branch
from
Draft

[Draft] OpenSora Llama3 Internal #702

wants to merge 14 commits into from
+1,193 −6

Commits on Oct 17, 2024

  1. add Llama3 model

    @zhtmike
    zhtmike committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    6d529d5 View commit details
    Browse the repository at this point in the history

  2. adapting to movie gen

    @zhtmike
    zhtmike committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    5be79a3 View commit details
    Browse the repository at this point in the history

  3. model adapted to movie gen

    @zhtmike
    zhtmike committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    be0c8b6 View commit details
    Browse the repository at this point in the history

  4. add caption embedder

    @zhtmike
    zhtmike committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    f6561e2 View commit details
    Browse the repository at this point in the history

  5. use fp32 layernorm

    @zhtmike
    zhtmike committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    9249fc3 View commit details
    Browse the repository at this point in the history

  6. add opensora wrapper

    @zhtmike
    zhtmike committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    61d9bf5 View commit details
    Browse the repository at this point in the history

  7. fix embedding & fix wrapper

    @zhtmike
    zhtmike committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    bd7fe30 View commit details
    Browse the repository at this point in the history

  8. fix inference with cfg=1.0

    @zhtmike
    zhtmike committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    df136b5 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. change to mint

    @zhtmike
    zhtmike committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    239f822 View commit details
    Browse the repository at this point in the history

  2. add linear patch embedder

    @zhtmike
    zhtmike committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    915c3c9 View commit details
    Browse the repository at this point in the history

  3. fix error from mint and eps

    @zhtmike
    zhtmike committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    85097fa View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. fix nan loss for abs embedding

    @zhtmike
    zhtmike committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    02e535d View commit details
    Browse the repository at this point in the history

  2. add Llama3 5B wrapper

    @zhtmike
    zhtmike committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    a297418 View commit details
    Browse the repository at this point in the history

  3. add column parallel linear for MP

    @zhtmike
    zhtmike committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    69f2a6e View commit details
    Browse the repository at this point in the history