Skip to main content
megatron.model.language_model.get_language_model
-
megatron.model.language_model.get_language_model(num_tokentypes, add_pooler: bool, encoder_attn_mask_type, init_method=None, scaled_init_method=None, add_encoder=True, add_decoder=False, decoder_attn_mask_type=AttnMaskType.causal, pre_process=True, post_process=True, args=None, model_type=None)