megatron.model.distributed
==========================

.. rubric:: Description

.. automodule:: megatron.model.distributed

.. currentmodule:: megatron.model.distributed


.. rubric:: Classes

.. autosummary::
    :toctree: .
    
    DistributedDataParallel
    
    DistributedDataParallelBase
    
    MemoryBuffer