megatron.global_vars

Description

Megatron global variables.

Functions

get_adlr_autoresume()	ADLR autoresume object.
get_args()	Return arguments.
get_counters()	Return counters.
get_current_global_batch_size()
get_num_microbatches()
get_signal_handler()
get_tensorboard_writer()	Return our wrapped tensorboard/wandb writer.
get_timers()	Return timers.
get_tokenizer()	Return tokenizer.
rebuild_tokenizer(args)
set_global_variables(args)	Set args, tokenizer, tensorboard_writer, adlr_autoresume, and timers.
update_num_microbatches(consumed_samples[, ...])