megatron.data.t5_dataset.make_attention_mask_3d#

megatron.data.t5_dataset.make_attention_mask_3d(source_block, target_block)#

Returns a 3-dimensional (3-D) attention mask :param source_block: 1-D array :param target_block: 1-D array