megatron.model.glu_activations.LiGLU#

class megatron.model.glu_activations.LiGLU#

Bases: _GLUBaseModule