megatron.microbatches.ConstantNumMicroBatches#

class megatron.microbatches.ConstantNumMicroBatches(global_batch_size, micro_batch_size, data_parallel_size)#

Bases: NumMicroBatchesCalculator