megatron.global_vars.get_tokenizer#

megatron.global_vars.get_tokenizer()#

Return tokenizer.