Plotting an ROC curve with spacy

Kookaburra 0
Viewed 34

I have managed to train a custom NER model using Spacy and I would like to demonstrate its ROC curve. I am able to use Scorer (https://spacy.io/api/scorer) to get final Recall, Precision and F-score but I would like to visualise the ROC curve in matplotlib.

How would I go about plotting the ROC using this platform?

roc machine-learning spacy nlp
1 Answers

A ROC curve is plotted based on variation when changing the classification threshold. But the spaCy NER model doesn't have a threshold parameter for classification, so you can't do this.

You could strain a spancat and use the threshold setting in that to get a curve.

polm230
Related