megatron.microbatches.RampupBatchsizeNumMicroBatches#

class megatron.microbatches.RampupBatchsizeNumMicroBatches(start_batch_size, batch_size_increment, ramup_samples, global_batch_size, micro_batch_size, data_parallel_size)#

Bases: NumMicroBatchesCalculator