megatron.optimizer.optimizer
============================

.. rubric:: Description

.. automodule:: megatron.optimizer.optimizer

.. currentmodule:: megatron.optimizer.optimizer


.. rubric:: Classes

.. autosummary::
    :toctree: .
    
    FP32Optimizer
    
    Float16OptimizerWithFloat16Params
    
    MegatronOptimizer
    
    MixedPrecisionOptimizer