Can we generate custom logs for Sagemaker notebook instance in CloudWatch?

Question

CloudWatch records logs for Sagemaker instance such as Kernel Started, Kernel shutdown, Notebook Saved etc by default. Though, I want to list some custom logs along with these default logs.

Please have a look at the picture attached.

Sample image of How default logs for a Sagemaker notebook instance look in CloudWatch

The goal is to be able to see some custom logs with these. For example - 'Cell 1 executed!'

user_6411548 · Answer

Jupyter server emits logs to stdout. So for notebook instances at least you can access the logs from CloudWatch. These would be under the /aws/sagemaker/NotebookInstances log group.

You can follow the below steps to automatically log kernel level logs to CW -

Choose Notebook instances.
In the list of notebook instances, choose the notebook instance for which you want to view Jupyter logs by selecting the Notebook instance Name.
This will bring you to the details page for that notebook instance.
Under Monitor on the notebook instance details page, choose View logs.
In the CloudWatch console, choose the log stream for your notebook instance. Its name is in the form NotebookInstanceName/jupyter.log.

Reference: https://docs.aws.amazon.com/sagemaker/latest/dg/jupyter-logs.html

Can we generate custom logs for Sagemaker notebook instance in CloudWatch?

1 Answers