Trying to run Pyspark job on Google Cloud Dataproc.
Even after the installation of sparknlp I'm getting this error.
I'm trying to import like this:
from sparknlp.annotator import Lemmatizer, Stemmer, Tokenizer, Normalizer
And getting this error:
ModuleNotFoundError: No module named 'sparknlp'
Can you help me in finding the reason behind this?