megatron.memory.RingMemBuffer#

class megatron.memory.RingMemBuffer(name, num_buffers, numel, dtype, track_usage)#

Bases: object

A ring of memory buffers.