megatron.text_generation_server.MegatronGenerate

class megatron.text_generation_server.MegatronGenerate(model)

Bases: Resource

methods: t.ClassVar[t.Collection[str] | None] = {'PUT'}

The methods this view is registered for. Uses the same default (["GET", "HEAD", "OPTIONS"]) as route and add_url_rule by default.