megatron.optimizer.grad_scaler# Description Megatron grad scaler. Classes ConstantGradScaler(initial_scale) DynamicGradScaler(initial_scale, min_scale, ...) MegatronGradScaler(initial_scale)