Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance evaluation details #48

Open
MarekKowalski opened this issue Dec 18, 2024 · 2 comments
Open

Performance evaluation details #48

MarekKowalski opened this issue Dec 18, 2024 · 2 comments

Comments

@MarekKowalski
Copy link

Hello!

The paper mentions that you get 0.015s per frame for the 256x256 model on RTX4090. Can you share more about how that is calculated?

On my end, on RTX3090, calling EncoderNoPoSplat.forward for 256x256 me 0.25s per frame, which seems to be more than the difference between the 3090 and 4090 would suggest. I run every frame separately (batch size of 1), the time is averaged over about 100 forward passes. Any thoughts on what may be leading to such a different result for me?

Thanks,

Marek

@botaoye
Copy link
Collaborator

botaoye commented Dec 25, 2024

Hi, thank you for your interest in our work, our reported runtime is calculated here and the results will be printed out/saved at the end of the evaluation.

Could you please share your results using this function?

@MarekKowalski
Copy link
Author

Thanks a lot for sharing. Once I get the training code running I'll let you know what numbers I am getting there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants