megatron.data.indexed\_dataset ============================== .. rubric:: Description .. automodule:: megatron.data.indexed_dataset .. currentmodule:: megatron.data.indexed_dataset .. rubric:: Classes .. autosummary:: :toctree: . IndexedCachedDataset IndexedDataset IndexedDatasetBuilder MMapIndexedDataset MMapIndexedDatasetBuilder .. rubric:: Functions .. autosummary:: :toctree: . code create_doc_idx data_file_path dataset_exists get_available_dataset_impl index_file_path infer_dataset_impl make_builder make_dataset read_longs write_longs