Uses self-entropy/self-attention to learn the first layer in a two layer neural network with a single pass. Self-entropy is calculated as: entropy(softmax(softmax(X*X^T)*X))
-
Notifications
You must be signed in to change notification settings - Fork 0
Unsupervised feed forward layer learning with a single pass.
License
pointlander/onward
About
Unsupervised feed forward layer learning with a single pass.
Topics
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published