Add Magvit-v2 (vqvae) #656
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
hqkate
requested review from
CaitinZhao,
SamitHuang and
zhanghuiyao
as code owners
SamitHuang
reviewed
Sep 12, 2024
examples/magvit/README.md
Outdated
|
|
||
| For the pretraining of VQVAE-2d, we provide a pretrained model weights as follow: | ||
|
|
||
| | Model | Dataset | Image Size | Weights | PSNR | SSIM | |
There was a problem hiding this comment.
what is the weights here?
There was a problem hiding this comment.
I was about to upload the pretrained model weights and provide a download link in the readme. But since this PR is not the final version of the code, I probably won't put the model weights now. The "weight" column has been removed, please check, thanks thanks~
SamitHuang
reviewed
Sep 12, 2024
| @@ -0,0 +1,347 @@ | |||
| # Copyright 2024 Huawei Technologies Co., Ltd | |||
| # Copyright (c) 2022-present, Kakao Brain Corp. | |||
There was a problem hiding this comment.
remove these copyright
CaitinZhao
reviewed
Sep 13, 2024
examples/magvit/README.md
Outdated
| @@ -0,0 +1,119 @@ | |||
| # MAGVIT-v2: Language Model Beats Diffusion -- Tokenizer is Key to Visual Generation | |||
|
|
|||
| This folder contains the Mindspore implementation of [MAGVIT-v2](https://arxiv.org/pdf/2310.05737). | |||
There was a problem hiding this comment.
add original code repo
There was a problem hiding this comment.
源碼沒有開源，在Readme加了説明，也列明了一些參考的代碼倉
Update readme and minor fix
* name change * bugfix inflate * minor fix * modify config
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Adds Mavgit-v2 VQVAE training scripts, supporting both pynative and graph mode.
Fixes # (issue)
Adds # (feature)
Before submitting
What's New. Here are thedocumentation guidelines
Who can review?
Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.
@xxx