I need to export BigQuery partitioned data in partitioned manner, what I mean by this is for example:
Bigquery table has 2 partitions let say on load_date(int) column i.e., 20220923 & 20220924 then when I export it to Cloud Storage the folder structure should looks like:
gs://bucket/exportfolder/load_date=20220923/exported_data_for_this_partition_only_*.csv gs://bucket/exportfolder/load_date=20220924/exported_data_for_this_partition_only_*.csv
Is there any simple way to do it in BigQuery itself? Any solution will help.
Note: Tried exporting in loops for each partition and its time consuming.