Recommended method for uploading many small files to Google Cloud Storage via Python

Viewed 1498

I have a project that regularly needs to upload millions of tiny (1 - 3 KB) image files to Google Cloud Storage. What's the recommended method/library to do this? I'm currently using gsutil but wonder if there's a better library. I recently came across google-cloud but it seems to be even slower (using blob.upload_from_filename()).

I'd like to be able to do this via Python (windows) but am open to other options if they provide significant performance advantages.

Any suggestions?

1 Answers
Related