megatron.schedules.forward_backward_no_pipelining#
- megatron.schedules.forward_backward_no_pipelining(forward_step_func, data_iterator, model, optimizer, timers, forward_only, collect_non_loss_data=False)#
Run forward and backward passes with no pipeline parallelism (no inter-stage communication).
Returns dictionary with losses.