Skip to content

Commit

Permalink
Updating sparse_lion
Browse files Browse the repository at this point in the history
  • Loading branch information
jloveric committed Dec 23, 2023
1 parent 385e818 commit 276c8bd
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion config/optimizer/sparse_lion.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
name: sparse_lion
# lr supposed to be 3 to 5 times smaller than adam
lr: 1e-5
patience: 5
patience: 15
factor: 0.1
gamma: 0.9
scheduler: plateau # exponential

0 comments on commit 276c8bd

Please sign in to comment.