I tried to concatenate multiple csv file with gsutil cat and gsutil compose but the problem is that in the output file the header is getting repeated which result in data discrepancy.
I tried to concatenate multiple csv file with gsutil cat and gsutil compose but the problem is that in the output file the header is getting repeated which result in data discrepancy.
You can't do it directly with gsutil. But I wrote an article where I use BigQuery to (try to) solve this problem