New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于论文中注意力热力图的问题 #30

Open

Transformer0714 opened this issue Nov 10, 2023 · 2 comments

Transformer0714 commented Nov 10, 2023 •

edited

Loading

作者你好，论文案例分析中的注意力热力图是如何绘制的，比如模型有多层，每一层又有多个注意力头，是选取的其中一个吗

Member

aptx1231 commented Dec 11, 2023

对的选择某一个层

lsy-study commented Dec 12, 2024

请问下如何生成这样的热图，1.是要加入其他代码才能让它生成吗？要加什么代码？2.还是热图已经生成出来了，在哪里查找呢？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment