megatron.text_generation.generation

Description

Generation utilities.

Functions

beam_search_and_return_on_first_stage(model, ...)
generate_tokens_probs_and_return_on_first_stage(...)	Main token generation function.
score_and_return_on_first_stage(model, ...)	Function for just scoring.