Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Opensora-PKU] v1.2.0 training and inference #647

Open
wants to merge 165 commits into
base: master
Choose a base branch
from

Conversation

wtomin
Copy link
Collaborator

@wtomin wtomin commented Aug 29, 2024

Support:

  1. run vae reconstruction, t2i and t2v inference;
  2. train stage 1 ~ 5;
  3. Training with zero2, zero3, and sequence parallelism;
  4. Training in pynative mode.
    Overfitting experiment was conducted for stage 3 (29x480p). The overfitting loss curves and generated videos were similar to torch's overfitting experiment.

@wtomin wtomin force-pushed the op-v1.2-diffusers branch 7 times, most recently from 28178c8 to 9ace7c5 Compare September 2, 2024 03:41
@wtomin wtomin requested a review from vigo999 as a code owner September 2, 2024 07:28
@wtomin wtomin force-pushed the op-v1.2-diffusers branch 11 times, most recently from ddcbb68 to 0c74b73 Compare September 5, 2024 08:17
@wtomin wtomin changed the title Opensora-pku training and inference [Opensora-PKU] v1.2.0 training and inference Oct 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants