venv on AWS sagemaker notebook not working

Question

I just launched AWS Sagemaker studio and trying to create virtual environment to work with as below:

python3 -m venv venv
source venv/bin/activate
pip install -r requirements.txt

venv works for my python scripts on Sagemaker. I am able to import the packages in my script as "import pandas as pd"

But When I tried opening a Jupyter notebook on Sagemaker and run import pandas as pd I am getting error as ModuleNotFoundError: No module named 'pandas'

How do I use venv in my notebook? Thanks.

user_2458691 · Answer

SageMaker Studio notebooks run on apps that use docker images. Here is a workaround to use conda environments in SageMaker Studio notebooks (use EFS for persistence across app restarts) https://github.com/durgasury/efs_backed_conda

I work at AWS and opinions are my own.

venv on AWS sagemaker notebook not working

1 Answers