megatron.core.parallel_state.get_data_parallel_group#

megatron.core.parallel_state.get_data_parallel_group()#

Get the data parallel group the caller rank belongs to.