megatron.data.indexed_dataset.IndexedDatasetBuilder#

class megatron.data.indexed_dataset.IndexedDatasetBuilder(out_file, dtype=<class 'numpy.int32'>)#

Bases: object