Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Artifacts in output #33

Open
y2k0999 opened this issue Dec 12, 2023 · 2 comments
Open

Artifacts in output #33

y2k0999 opened this issue Dec 12, 2023 · 2 comments

Comments

@y2k0999
Copy link

y2k0999 commented Dec 12, 2023

I'm getting weird artifacts in very fine parts of my images in certain color channels. Any idea what part of the model I can play with to try to resolve these artifacts?

Screenshot from 2023-12-12 18-22-24

@y2k0999
Copy link
Author

y2k0999 commented Dec 12, 2023

When I use less frames from my burst as input the effects get even more serious
Screenshot from 2023-12-12 18-41-39

@Jamy-L
Copy link
Owner

Jamy-L commented Dec 12, 2023

We observed that these color artefacts were typically appearing when there are not enough samples during the local fusion. This can be because there are not enough frames (as you pointed out), but also because the fusion kernel is too thin, or because the alignment module did not perform good enough.

Your first picture is actually very interesting, because we can see it happening on the left: as the structure gets thinner, the fusion kernel becomes too thin and cant get enough samples. When the structure get too thin, the structure tensor can no longer pick up the high frequencies, so the fusion kernel gets larger and the artefact no longer appear.

To solve the problem, you can use this postprocessing that worked quite well for removing this type of artefacts. You can also increase k_detail, which should ensure that every colour channel gets enough samples during fusion.

If you really want to go deeper into the kernel engineering, the kernel shaping is done here. By playing around with different functions to drive k[0] and k[1] more or less agressively, one may get better results.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants