Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Flux LoRA merge #414

Open
diodiogod opened this issue Oct 25, 2024 · 3 comments
Open

Support for Flux LoRA merge #414

diodiogod opened this issue Oct 25, 2024 · 3 comments

Comments

@diodiogod
Copy link

Please, may you consider support for merging Flux LoRAs?
Specially with block weights? Maybe consider supporting 19 or 57 values input for the blocks. Refer to this discussion with @nihedon
nihedon/sd-webui-lora-block-weight#2 (comment)

Right now the only tool I know of to merge loras is some nodes on comfyui and this: https://github.com/Anashel-RPG/anashel-utils
And to save loras with modified block weights, I tried to create my own tool, but I'm not sure what is the proper target layers: https://github.com/diodiogod/Flux-Block-Weight-Remerger

I would love to be able to use supermerger again, like I did with SDXL, for flux, specially with the "same to Strength" option.

Thanks!!

@diodiogod diodiogod changed the title Suport for Flux LoRA merge Support for Flux LoRA merge Oct 25, 2024
@duskfallcrew
Copy link
Contributor

There's no way to do it on A111 as there's no flux support AFAIK.

@diodiogod
Copy link
Author

There's no way to do it on A111 as there's no flux support AFAIK.

I'm asking for Forge, obviously. Nihedon managed to port LBW to forge and then managed to support Flux. From what I understand, hako-mikan implemented support for Forge, but so far, the lora merging for flux don't work.
I opened a ticket to so hako-mikan knows this is wanted. I hope it gets implemented! =D

@duskfallcrew
Copy link
Contributor

There's no way to do it on A111 as there's no flux support AFAIK.

I'm asking for Forge, obviously. Nihedon managed to port LBW to forge and then managed to support Flux. From what I understand, hako-mikan implemented support for Forge, but so far, the lora merging for flux don't work. I opened a ticket to so hako-mikan knows this is wanted. I hope it gets implemented! =D

If you try the "replace pluslora.py" with the branch/tree 20's version IT MIGIHT work, but that's dependent on the fact it worked for me on a vast instance, and i'm not running forge.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants