How to extract a very big file in Google Colab

Viewed 1157

I am trying to extract a 14.6 GB 7z file (https://archive.org/download/stackexchange/stackoverflow.com-Posts.7z).

I have it downloaded and saved in my Google Drive. I mount my drive to Google Colab and then change the current directory to where the file is located: os.chdir('/content/drive/My Drive/.../')

When I try to unzip the file !p7zip -k -d stackoverflow.com-Posts.7z, it uses the current instance's HDD space and during this process, it runs out of all the available allocated HDD space, and hence the unzip abruptly terminates.

Is there a way to extract the file without using the instance's HDD space OR do it in chunks, such that the extract is successful.

PS: I believe, when decompressed the file size is ~100 GB

1 Answers
Related