megatron.tokenizer.gpt2\_tokenization.GPT2Tokenizer
===================================================

.. currentmodule:: megatron.tokenizer.gpt2_tokenization

.. autoclass:: GPT2Tokenizer
   :members:
   :special-members:
   :show-inheritance:
   :exclude-members: __weakref__, __init__