megatron.model.glu\_activations.SwiGLU
======================================

.. currentmodule:: megatron.model.glu_activations

.. autoclass:: SwiGLU
   :members:
   :special-members:
   :show-inheritance:
   :exclude-members: __weakref__, __init__