megatron.core.parallel_state.model_parallel_is_initialized

megatron.core.parallel_state.model_parallel_is_initialized()

Check if model and data parallel groups are initialized.