megatron.optimizer.distrib\_optimizer.DistributedOptimizer
==========================================================

.. currentmodule:: megatron.optimizer.distrib_optimizer

.. autoclass:: DistributedOptimizer
   :members:
   :special-members:
   :show-inheritance:
   :exclude-members: __weakref__, __init__