How to set the block(chunk) size for a Google Cloud Store Bucket?

user_2704265 0
Viewed 141

I am reading this article. It said "To demonstrate this, let’s take an 8MB file, and fetch it through different sized chunks. In the graph below, we can see that as the block size gets larger, performance improves. As the chunk size decreases, the overhead per-transaction increases, and performance slows down." in section "Set your optimal fetch size".

However, I try to check the Google Cloud Storage settings but there are no "block size", "chunk size" or "fetch size". Where is such a setting?

google-cloud-storage
1 Answers

A part of the answer is in the answer, this parameter

GSUtil:sliced_object_download_max_components=8

It allows you to download in a number of slice. In the given example, it is used on a 8Mb file and therefore you can deduce the size of each chunk. The size of the chunks aren't important in the article, but the HTTP overhead incurs: the more chunks you have, the more HTTP request you get, and therefore, the more HTTP overhead you pay (in time manner)

user_113725930
Related