megatron.core.parallel_state.get_data_parallel_rank#

megatron.core.parallel_state.get_data_parallel_rank()#

Return my rank for the data parallel group.