How to change learning rate dynamically during training process? #2072
-
How to change learning rate dynamically during training process? Not set a fixed learning rate in config file, but dynamically change learning rate during training process. |
Beta Was this translation helpful? Give feedback.
Answered by
JingweiZhang12
Nov 30, 2022
Replies: 1 comment 1 reply
-
You can write a hook to set a custom learning rate if the current learning schedule does not meet your need. https://github.com/open-mmlab/mmengine/blob/main/mmengine/hooks/param_scheduler_hook.py |
Beta Was this translation helpful? Give feedback.
1 reply
Answer selected by
MSTK2014
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
You can write a hook to set a custom learning rate if the current learning schedule does not meet your need. https://github.com/open-mmlab/mmengine/blob/main/mmengine/hooks/param_scheduler_hook.py
Or, you can write a new learning schedule. https://github.com/open-mmlab/mmengine/blob/main/mmengine/optim/scheduler/param_scheduler.py