megatron.p2p_communication.send_backward_recv_forward#

megatron.p2p_communication.send_backward_recv_forward(input_tensor_grad, tensor_shape=None, timers=None)#

Batched send and recv with previous rank in pipeline.