megatron.data.data_samplers

Description

Dataloaders.

Classes

MegatronPretrainingRandomSampler(dataset, ...)
MegatronPretrainingSampler(total_samples, ...)
RandomSeedDataset(dataset)

Functions

build_pretraining_data_loader(dataset, ...)

Buld dataloader given an input dataset.