megatron.model.glu\_activations
===============================

.. rubric:: Description

.. automodule:: megatron.model.glu_activations

.. currentmodule:: megatron.model.glu_activations


.. rubric:: Classes

.. autosummary::
    :toctree: .
    
    GEGLU
    
    LiGLU
    
    ReGLU
    
    SwiGLU