Using GPT-2 with your own dictionary of words

Viewed 507

I'm training the gpt-2 with custom encodings and custom vocab.bpe file. However, when I generate text using gpt-2, the output tokens have range that exceeds the range of my new encodings. How can I make gpt-2 work for me then?

0 Answers
Related