megatron.core.parallel_state.get_position_embedding_group

megatron.core.parallel_state.get_position_embedding_group()

Get the position embedding group the caller rank belongs to.