Jupyter notebook is slow/laggy, even with refreshed kernel and no outputs/cells running

user_11302142 0
Viewed 2888

Jupyter notebook with about 600 lines or so suddenly got very laggy this past week. Previously all cells would run instantly, the file is mostly just simple pandas aggregations and column functions.

Now, when I reset kernel and outputs, even just clicking into a cell, not even running it, takes ~6 seconds. The screen freezes up, and goes back to normal after a bit. If I run the cell the same thing happens, even though the cell could just be a simple column renaming.

Any ideas? I do not recall changing anything about my Python or Jupyter installation, same packages and everything from a week ago when it worked fine.

Edit: I should add that I restarted computer several times as well but still same poor performance

I created a new notebook, it runs fine, but after a couple hours it slows down as well, even if memory usage is low (just a small dataframe)

jupyter-notebook python
2 Answers

If you use nbextension for Jupyter try to disable Variable Inspector (Edit -> nbextensions config)

user_29754380

The following reasons are possible:

  1. Changes of other software within your systems.
  2. The data to be handled by Pandas is much bigger now and it consume more memory.

Possible ways to find out the cause(s)

  1. Try out same Jupyter Notebook using smaller datasets.
  2. Try out the same Python code using command line instead of from within Jupyter Notebook.

In both cases, you should restart your computer before performing the test. You should also monitor CPU, disk and memory utilization before, during and after.

user_27451400
Related