megatron.p2p_communication.send_backward_recv_backward#

megatron.p2p_communication.send_backward_recv_backward(input_tensor_grad, recv_next, tensor_shape=None, timers=None)#

Batched recv from next rank and send to previous rank in pipeline.