megatron.optimizer_param_scheduler#
Description
Learning rate decay and weight decay incr functions.
Classes
|
Anneals learning rate and weight decay |
Description
Learning rate decay and weight decay incr functions.
Classes
|
Anneals learning rate and weight decay |