megatron.optimizer.grad\_scaler
===============================

.. rubric:: Description

.. automodule:: megatron.optimizer.grad_scaler

.. currentmodule:: megatron.optimizer.grad_scaler


.. rubric:: Classes

.. autosummary::
    :toctree: .
    
    ConstantGradScaler
    
    DynamicGradScaler
    
    MegatronGradScaler