megatron.core.parallel_state.get_data_parallel_src_rank#

megatron.core.parallel_state.get_data_parallel_src_rank()#

Calculate the global rank corresponding to the first local rank in the data parallel group.