Convert multiple parquet files to individual csv's

Viewed 20

I am trying to convert multiple parquet files to individual csv's. I have tried this code found here but when i run it, it only converts around 10 of the files.

import pandas as pd
import glob
from fastparquet import ParquetFile

path = '.'
prqtfiles = glob.glob(path + "/*.parquet")
for p in prqtfiles:
 pr = ParquetFile(p, sep='\t')
 df = pr.to_pandas()
 df.to_csv(p[:-8] + '.csv', index=False)

Any idea why its doing this? Thanks, David

0 Answers
Related