-
Notifications
You must be signed in to change notification settings - Fork 71
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update the readme of the diffusers sdxl&sd. #655
base: master
Are you sure you want to change the base?
Conversation
@@ -15,6 +15,9 @@ Before running the scripts, make sure to install the library's training dependen | |||
|
|||
**Important** | |||
|
|||
The training script is compute-intensive and only runs on an Ascend 910*. Please run the scripts with CANN version ([CANN 7.3.0.1.231](https://www.hiascend.com/developer/download/community/result?module=cann&cann=8.0.RC2.beta1)) and MindSpore version ([MS2.3.0](https://www.mindspore.cn/versions#2.3.0)); You can use |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
CANN 7.3.0.1.231 (link: cann=8.0.RC2.beta1)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
|--------|------|------------------------|--------------|-----------|---------------|---------------------|------------------| | ||
| lora | 1 | 1*1 | 512x512 | FP16 | 1~5 mins | 200 | 5.00 | | ||
| lora | 8 | 1*8 | 512x512 | FP16 | 1~5 mins | 231 | 34.63 | | ||
|
||
### Inference | ||
|
||
Once you have trained a model using above command, the inference can be done simply using the `StableDiffusionPipeline` after loading the trained LoRA weights. You |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这里介绍训出来的lora权重是 sd-onepiece-model-lora,下面的推理命令没有延续训出来的onepiece,而是直接跳到从hub下Pokemon,performance 紧接着展示了one piece的训练效果;建议调整
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
1583ea9
to
a3c9d77
Compare
@@ -83,13 +134,6 @@ In a nutshell, LoRA allows adapting pretrained models by adding pairs of rank-de | |||
With LoRA, it's possible to fine-tune Stable Diffusion on a custom image-caption pair dataset | |||
on consumer GPUs like Tesla T4, Tesla V100. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
delete?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done
7458fe8
to
5a18313
Compare
0c67ab6
to
a77bc10
Compare
What does this PR do?
Update the readme of sdxl and sd in diffusers and supplement the experimental data.
Fixes # (issue)
Adds # (feature)
Before submitting
What's New
. Here are thedocumentation guidelines
Who can review?
Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.
@xxx