megatron.initialize.initialize_megatron

megatron.initialize.initialize_megatron(extra_args_provider=None, args_defaults={})

Set global variables, initialize distributed, and set autoresume and random seeds. allow_no_cuda should not be set unless using megatron for cpu only data processing. In general this arg should not be set unless you know what you are doing.