megatron.data.data_samplers.MegatronPretrainingRandomSampler

class megatron.data.data_samplers.MegatronPretrainingRandomSampler(dataset, total_samples, consumed_samples, micro_batch_size, data_parallel_rank, data_parallel_size, data_sharding)

Bases: object