megatron.data.bert_dataset

Description

BERT Style dataset.

Classes

BertDataset(name, indexed_dataset, ...)

Functions

build_training_sample(sample, ...)	Biuld training sample.
pad_and_convert_to_numpy(tokens, tokentypes, ...)	Pad sequences and convert them to numpy.