Skip to content

Plots how the logit values that are passed into the softmax function change over time as the model is trained.

License

Notifications You must be signed in to change notification settings

elliotwaite/softmax-logit-paths

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 

Repository files navigation

Softmax Logit Paths Visualised

Use main.py to visualize how the logit values that are passed into the softmax function change over time as the model is trained with SGD (stochastic gradient descent) or the Adam optimizer.

This code if from my YouTube video:

Softmax Function Explained In Depth with 3D Visuals

https://youtu.be/ytbYRIN0N4g

About

Plots how the logit values that are passed into the softmax function change over time as the model is trained.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages