megatron.text\_generation.communication
=======================================

.. rubric:: Description

.. automodule:: megatron.text_generation.communication

.. currentmodule:: megatron.text_generation.communication




.. rubric:: Functions

.. autosummary::
    :toctree: .
    
    broadcast_float_list
    
    broadcast_from_last_pipeline_stage
    
    broadcast_from_last_to_first_pipeline_stage
    
    broadcast_int_list
    
    broadcast_list
    
    broadcast_tensor
    
    copy_from_last_to_first_pipeline_stage
    
    recv_from_prev_pipeline_rank_
    
    send_to_next_pipeline_rank