megatron.utils.print_rank_last

megatron.utils.print_rank_last(message)

If distributed is initialized, print only on last rank.