megatron.optimizer.distrib_optimizer.Range#

class megatron.optimizer.distrib_optimizer.Range(start, end)#

Bases: object

A range represents a start and end points for indexing a shard from a full tensor.

__str__()#

Return str(self).