-
Notifications
You must be signed in to change notification settings - Fork 71
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix OpenSora 1.2 training #643
Fix OpenSora 1.2 training #643
Conversation
@@ -35,6 +35,8 @@ | |||
|
|||
|
|||
class STDiT3Block(nn.Cell): | |||
# to reduce compilation time | |||
@ms.lazy_inline(policy="front") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
vae的encoder和decoder也加下吧,解决动态shape OOM的问题
@@ -18,7 +18,7 @@ python scripts/train.py \ | |||
--pretrained_model_path="models/OpenSora-STDiT-v3/opensora_stdit_v3.ckpt" \ | |||
--mode=0 \ | |||
--jit_level O1 \ | |||
--max_device_memory 59GB \ | |||
--max_device_memory 55GB \ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What does this affect?
bf3b638
to
94cbbb4
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Set drop_remainder
here to False as well to keep the consistency?
ba75c9d
to
a7a073f
Compare
ada3f47
to
5c5e382
Compare
What does this PR do?
Fixes # (issue)
Acceleration:
Before submitting
What's New
. Here are thedocumentation guidelines
Who can review?
Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.
@xxx