megatron.data.t5_dataset.pad_and_convert_to_numpy#
- megatron.data.t5_dataset.pad_and_convert_to_numpy(tokens, masked_positions, masked_labels, pad_id, max_seq_length, max_seq_length_dec, masked_spans=None, bos_id=None, eos_id=None, sentinel_tokens=None)#
Pad sequences and convert them to numpy.