megatron.optimizer.clip\_grads
==============================

.. rubric:: Description

.. automodule:: megatron.optimizer.clip_grads

.. currentmodule:: megatron.optimizer.clip_grads




.. rubric:: Functions

.. autosummary::
    :toctree: .
    
    clip_grad_norm_fp32
    
    count_zeros_fp32