I want to use en_core_web_trf model in spaCy library for Named entity recognition. However, the guide for training a custom model does not contain information for finetuning a pretrained model.
How can one finetune an NER model in spaCy v3.0?
Using spaCy for finetuning a NER model in spaCy 3.0
Viewed 1618
1 Answers
It's recommended you train your NER component from scratch rather than fine-tuning the existing model, because fine-tuning the existing model is prone to catastrophic forgetting. Note that even if your NER component is trained from scratch, you're still using the Transformer as a starting point, so you aren't starting from nothing.
More details about why not to re-train the existing NER, and how to do it if you want to, are in the FAQ. There are also many threads about this topic in the Discussion in general.
Related