I have been working on transforming of 20000 files located in gcp bucket, but my dataflow job was unable to process all the files at once. Does there is a method to read only 100 files not 20000 at the same time?
0 Answers
Related
I have been working on transforming of 20000 files located in gcp bucket, but my dataflow job was unable to process all the files at once. Does there is a method to read only 100 files not 20000 at the same time?