megatron.model.transformer
==========================

.. rubric:: Description

.. automodule:: megatron.model.transformer

.. currentmodule:: megatron.model.transformer


.. rubric:: Classes

.. autosummary::
    :toctree: .
    
    CoreAttention
    
    DropPath
    
    NoopTransformerLayer
    
    ParallelAttention
    
    ParallelMLP
    
    ParallelTransformer
    
    ParallelTransformerLayer
    




.. rubric:: Functions

.. autosummary::
    :toctree: .
    
    bias_dropout_add
    
    dropout_add
    
    get_bias_dropout_add
    
    get_dropout_add