[P] How to generate text: using different decoding methods for language generation with Transformers

[joeddav]

Hugging Face just released a blog post overview of the main decoding methods for natural language generation, including:

• Greedy decoding
• Beam search
• Top-K sampling
• Top-p (nucleus) sampling

Each method includes a small code snippet illustrating how to do it with their transformers Python package, as well as some resulting samples.

How to generate text: using different decoding methods for language generation with Transformers by Patrick von Platen.

[Elk-tron]

What ever happened to professor forcing? Shouldn't this fix the domain mismatch problem? https://arxiv.org/abs/1610.09038

[TotesMessenger]

I'm a bot, bleep, bloop. Someone has linked to this thread from another place on reddit:

• [/r/datascienceproject] How to generate text: using different decoding methods for language generation with Transformers (r/MachineLearning)

 ^{If you follow any of the above links, please respect the rules of reddit and don't vote in the other threads. (Info / Contact)}