megatron.timers.Timers

class megatron.timers.Timers(log_level, log_option)

Bases: object

Group of timers.

__call__(name, log_level=None)

Call self as a function.

log(names, rank=None, normalizer=1.0, reset=True, barrier=False)

Log a group of timers.

write(names, writer, iteration, normalizer=1.0, reset=False, barrier=False)

Write timers to a tensorboard writer Note that we only report maximum time across ranks to tensorboard.