megatron.microbatches.RampupBatchsizeNumMicroBatches#
- class megatron.microbatches.RampupBatchsizeNumMicroBatches(start_batch_size, batch_size_increment, ramup_samples, global_batch_size, micro_batch_size, data_parallel_size)#
Bases:
NumMicroBatchesCalculator