How to import from another ipynb file in EMR jupyter notebook which runs a PySpark kernel?

Viewed 833

I'm using jupyter notebook on AWS EMR to run PySpark, and is having trouble importing modules from another file. I tried a couple methods that I searched on stackoverflow, none worked. More specifically, I tried the following (here I have a notebook named "include.ipynb" in the same directory as the notebook that runs the import statements):

enter image description here

Both of these methods worked in jupyter notebook on my local computer. Why aren't they working on AWS?

1 Answers

You have to install these packages in your EMR explicitly using Pip or conda. Your local has those packages installed already.

Related