megatron.optimizer.grad_scaler.MegatronGradScaler#

class megatron.optimizer.grad_scaler.MegatronGradScaler(initial_scale)#

Bases: ABC