New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GMM attention #186

Open

bringtree opened this issue May 26, 2020 · 0 comments

Owner

bringtree commented May 26, 2020 •

edited

Loading

decoder端输入的query 计算出 GMM 的三个参数( w,u,sigma)

每个decoder时刻都会有一个给encoder 编码出来所有结果共用的 GMM
同时为了保证单调性，将u进行历史积累递增。

这样就能实现每次计算完，比如第一次在h_1 高权重，第二次就会在h_1之后来高权重而不会在 h_1 之前高权重。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment