megatron.p2p_communication.send_forward_recv_backward#

megatron.p2p_communication.send_forward_recv_backward(output_tensor, tensor_shape=None, timers=None)#

Batched send and recv with next rank in pipeline.