Spacy nlp = spacy.load("en_core_web_lg")

Question

I already have spaCy downloaded, but everytime I try the nlp = spacy.load("en_core_web_lg"), command, I get this error:

OSError: [E050] Can't find model 'en_core_web_lg'. It doesn't seem to be a shortcut link, a Python package or a valid path to a data directory.

I already tried

>>> import spacy
>>> nlp = spacy.load("en_core_web_sm")

and this does not work like it would on my personal computer.

My question is how do I work around this? What directory specifically do I need to drop the spacy en model into on my computer so that it is found?

user_8272593 · Answer

For a Linux system run the below code in terminal if you would be using a virtual environment else skip first and second command :

python -m venv .env
source .env/bin/activate
pip install -U spacy
python -m spacy download en_core_web_lg

The downloaded language model can be found at :

/usr/local/lib/python3.6/dist-packages/en_core_web_lg -->
/usr/local/lib/python3.6/dist-packages/spacy/data/en_core_web_lg

For more documentation information refer https://spacy.io/usage

Hope it was helpful.

user_7454706 · Answer

Commands to install any package from spacy check here about en_ore_web_lg ~800MB:

python -m spacy download en

python -m spacy download en_core_web_sm

user_8398247 · Answer

import en_core_web_sm
nlp = en_core_web_sm.load()

If this works, it'd indicate that the problem is related to the way spaCy detects installed packages. If it doesn't work and gives you an ImportError, it means that the Python environment the model was installed in is not the same as your Jupyter environment.

Also, maybe double-check that the model installed correctly? Models are installed as Python packages by running pip in a subprocess. And pip errors can sometimes be a bit subtle and not immediately obvious in the output.

user_18443714 · Answer

import spacy

spacy.cli.download("en_core_web_sm")
nlp = spacy.load("en_core_web_sm")

This works for me! I also searched a lot and found this answer there: How to download additional files from modules on pycharm

user_12543159 · Answer

In case pip install en_core_web_sm worked fine for you. You could apply en_core_web_sm.load() and store this into variable which will work similar to the command you are trying to do.

Failure of spacy.load could be due to the path setup for getting the library.

For more details you can read : I have explained custom NER in detail too.

https://medium.com/analytics-vidhya/spacy-knowing-these-secrets-will-make-wonderful-package-look-amazing-e0f53775720e

user_13086128 · Answer

!python -m spacy download en_core_web_lg

from your Jupyter cell, then:

[Ctrl+M] or `Restart runtime`

from menu bar on top of Jupyter notebook

Spacy nlp = spacy.load("en_core_web_lg")

6 Answers