We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
# multiply & normalize ->(B, N, C') energy = torch.bmm(proj_query, proj_key) energy_new = torch.max(energy, -1, keepdim=True)[0].expand_as(energy) - energy
# multiply & normalize ->(B, N, C')
energy = torch.bmm(proj_query, proj_key)
energy_new = torch.max(energy, -1, keepdim=True)[0].expand_as(energy) - energy
I think the normalization implemented in acfnet.py is different from the equation (2) in the original paper. And I wonder why you implement this way.
The text was updated successfully, but these errors were encountered:
I have the same question. Have you figured it out?
Sorry, something went wrong.
No branches or pull requests
# multiply & normalize ->(B, N, C')
energy = torch.bmm(proj_query, proj_key)
energy_new = torch.max(energy, -1, keepdim=True)[0].expand_as(energy) - energy
I think the normalization implemented in acfnet.py is different from the equation (2) in the original paper.
And I wonder why you implement this way.
The text was updated successfully, but these errors were encountered: