megatron.data.data_samplers.MegatronPretrainingSampler#

class megatron.data.data_samplers.MegatronPretrainingSampler(total_samples, consumed_samples, micro_batch_size, data_parallel_rank, data_parallel_size, drop_last=True)#: Bases: object