Can i clear up gpu vram in colab

user_18390515 0
Viewed 1227

I'm trying to use aitextgen to finetune 774M gpt 2 on a dataset. unfortunately, no matter what i do, training fails because there are only 80 mb of vram available. how can i clear the vram without restarting the runtime and maybe prevent the vram from being full?

fine-tune gpt-2 vram google-colaboratory
2 Answers

Another solution can be using these code snippets.

1.

!pip install numba
  1. Then:
from numba import cuda
# all of your code and execution
cuda.select_device(0)
cuda.close()

Your problem is discussed in Tensorflow official github. https://github.com/tensorflow/tensorflow/issues/36465

user_98480430
  1. Run the command !nvidia-smi inside a notebook block.
  2. Look for the process id for the GPU that is unnecessary for you to remove for cleaning up vram. Then run the command !kill process_id

It should help you.

user_98480430
Related