megatron.data.dataset_utils.pad_and_convert_to_numpy#

megatron.data.dataset_utils.pad_and_convert_to_numpy(tokens, tokentypes, masked_positions, masked_labels, pad_id, max_seq_length)#

Pad sequences and convert them to numpy.