How to copy notebooks between different Sagemaker instances?

user_5432304 0
Viewed 5303

My search didn't yield anything useful so I was wondering if there is any easy way to copy notebooks from one instance to another instance on Sagemaker? Of course other than manually downloading the notebooks on one instance and uploading to the other one!

amazon-sagemaker
4 Answers

The recommended way to do this (as of 12/16/2018) would be to use the newly- launched Git integration for SageMaker Notebook Instances.

  1. Create a Git repository for your notebooks
  2. Commit and push changes from Notebook Instance #1 to your Git repo
  3. Start Notebook Instance #2 using the same Git repo

This way your notebooks are persisted in the Git repo rather than on the instance, and the Git repo can be shared by multiple instances.

https://aws.amazon.com/blogs/machine-learning/amazon-sagemaker-notebooks-now-support-git-integration-for-increased-persistence-collaboration-and-reproducibility/

user_88991120

Thank you for using Amazon SageMaker.

Unfortunately the way suggested is only way of sharing notebooks between Notebook Instances.

Let us know if there is any other way we can be of assistance.

user_91819010

I might be late to the show, but I had recently to deal with copying the contents of a Sagemaker notebook to a different notebook. This problem may become urgent for users of Sagemaker notebooks on amazon Linux 1 (al1) platform. Such notebooks have 'notebook-al1-v1' platform identifier. Amazon announced that "Amazon SageMaker Notebook Instance is ending its standard support on Amazon Linux AMI (AL1)" on April 22, 2022.

Now, what are the steps needed to copy of file from one Sagemaker instances to a different one. Or, put it differently, how to synchronize EBS volume attached to one instance (let's call it A) to instance B.

Amazon published a step-by-step explanation how to do it. The idea is first to synchronize EBS volume of notebook A to a specially created AWS s3 bucket, and second to synchronize contents of that s3 bucket to notebook B. I followed instructions in the post, and it didn't work for me )). I later discovered that the script 'on_start.sh' in 'migrate-ebs-data-backup' provided in Amazon solution has some issues with s3 bucket creation.

Personally I found that rather than do what the Amazon post recommends it's much easier to create the ad hoc basket (let's call it 'ebs-data-backup') manually via console and then:

  1. launch Terminal of notebook A and enter the following code, which will synchronize contents of notebook A to bucket 'ebs-data-backup'

    $ cd /home/ec2-user/SageMaker
    $ BUCKET_NAME=ebs-data-backup
    $ TIMESTAMP=date +%F-%H-%M-%S
    $ SNAPSHOT=${NOTEBOOK_NAME}_${TIMESTAMP}
    $ aws s3 sync --exclude "/lost+found/" /home/ec2-user/SageMaker/ s3://${BUCKET_NAME}/${SNAPSHOT}/

  2. Start notebook B, launch Terminal in notebook B and enter the following code:

    $ cd /home/ec2-user/SageMaker
    $ aws s3 sync s3://${BUCKET_NAME}/${SNAPSHOT}/ /home/ec2-user/SageMaker/`

in notebook B use the same values for BUCKET_NAME and SNAPSHOT as in notebook B

echo "THAT SHOULD BE IT. HOPE IT HELPS"

user_76885480

an easy way to transfer can be to tar (zip like) the file on one instance and download. Upload in the new instance and then untar.

tar --help

user_136349250
Related