megatron.global_vars#
Description
Megatron global variables.
Functions
ADLR autoresume object. |
|
|
Return arguments. |
Return counters. |
|
Return our wrapped tensorboard/wandb writer. |
|
Return timers. |
|
Return tokenizer. |
|
|
|
|
Set args, tokenizer, tensorboard_writer, adlr_autoresume, and timers. |
|