megatron.model.glu_activations.GEGLU#

class megatron.model.glu_activations.GEGLU#

Bases: _GLUBaseModule